ALPHA Timepoint is in alpha Talk to Us
Sign In Get Started
P

Presentation of ELMo at NAACL 2018

Researchers present ELMo (Embeddings from Language Models) at NAACL 2018, showcasing a breakthrough in NLP to an audience of academics in a conference hall.

Setting

Ernest N. Morial Convention Center, New Orleans, USA. A large conference hall with modern architecture, high ceilings, and rows of seating facing a stage with a large projection screen.

Characters

The figures in this scene as an entity network — co-presence links everyone in the moment; speakers who trade lines are bound tighter. Turn the resolution dial to reveal depth the engine actually computed.

TNGF
SELECTED
Matthew Peters
primary
A man in his mid-30s with a lean build, short brown hair, and glasses. His face shows a mix of enthusiasm and focus, with a slight smile that suggests confidence in his work.
NAACL Chair
secondary
A middle-aged academic with a professional demeanor, wearing rectangular glasses that reflect the projector light. His salt-and-pepper hair is neatly combed, and he has a slight paunch indicative of long hours at a desk.
Grad Student
secondary
A young graduate student in their mid-20s, with a lean build and an eager expression. Their hair is slightly tousled from running between sessions, and they wear rectangular glasses that keep sliding down their nose.
Skeptical Professor
background
A middle-aged academic with a wiry build, thinning gray hair combed back, and sharp features accentuated by rectangular glasses. His furrowed brow and intense gaze suggest deep concentration mixed with skepticism.

Dialog

NAACL Chair Without further ado, let me introduce Dr. Matthew Peters, whose work on ELMo promises to redefine how we approach contextual embeddings in NLP.
Matthew Peters Thank you. Today, we present ELMo—deep contextualized word representations that model both complex characteristics of word use and how these uses vary across linguistic contexts.
Grad Student Wait, but—how does ELMo handle polysemy compared to traditional word embeddings? Like, 'bank' as in river versus financial...
Matthew Peters Excellent question. ELMo's bidirectional LSTM captures context from both directions, so 'bank' near 'water' versus 'money' activates different pathways in the deeper layers.
NAACL Chair Let's hold further questions until the Q&A—we're running tight on time.
Matthew Peters To summarize—ELMo provides a 6.2% average error reduction across six benchmark NLP tasks. We're releasing all code and pre-trained models today.
Grad Student So... this could finally make my dependency parsing experiments actually work?

Chat with Characters

You've used your 3 free turns

Sign in to keep chatting with characters from this moment — unlimited turns.

Sign in to Continue
— Sign in for unlimited

Causal neighbors · 63 linked moments

D
Demonstration of the perceptron by Frank Rosenblatt
1957 · same figure
P
Presentation of BERT at NAACL 2019
2019 · influences
P
Presentation of Attention Is All You Need at NIPS 2017
2017 · same era
P
Presentation of Attention Is All You Need at NIPS 2017
2017 · precedes
P
Presentation of RoBERTa at EMNLP 2019
2019 · same figure
G
Google I/O 2019 keynote
2019 · same era
G
Google I/O 2019 keynote
2019 · follows
R
Release of GPT-2 by OpenAI
2019 · same era
R
Release of GPT-2 by OpenAI
2019 · follows
P
Presentation of BERT at NAACL 2019
2019 · same era
P
Presentation of BERT at NAACL 2019
2019 · follows
P
Presentation of 'Attention Is All You Need' at NIPS 2017
2017 · same era
P
Presentation of 'Attention Is All You Need' at NIPS 2017
2017 · precedes
Apple Worldwide Developers Conference 2015 Opening Keynote
Apple Worldwide Developers Conference 2015 Opening Keynote
2015 · same era
Apple Worldwide Developers Conference 2015 Opening Keynote
Apple Worldwide Developers Conference 2015 Opening Keynote
2015 · precedes
2
2010 Los Angeles Marathon
2010 · same era
F
Facebook releases PyTorch as open source
2016 · same era
G
Google releases TensorFlow as open source
2015 · same era
A
Attention Is All You Need Paper Presentation at NIPS 2017
2017 · same era
X
XLNet Paper Presentation at ICML 2019
2019 · same era
M
Microsoft Build 2016 Opening Keynote
2016 · same era
F
First public release of Keras
2015 · same era
G
Google announces Google Assistant
2016 · same era
5
52nd Annual Grammy Awards
2010 · same era
L
Los Angeles Lakers win 2009 NBA Finals
2009 · same era
M
Microsoft announces Cortana
2014 · same era
M
Microsoft releases CNTK as open source
2015 · same era
A
Amazon announces Alexa
2014 · same era
M
Microsoft Build 2019 keynote
2019 · same era
Microsoft Build 2018 Keynote
Microsoft Build 2018 Keynote
2018 · same era
M
Microsoft Build 2019 keynote
2019 · precedes
X
XLNet Paper Presentation at ICML 2019
2019 · precedes
2
2010 Los Angeles Marathon
2010 · follows
F
Facebook releases PyTorch as open source
2016 · follows
G
Google releases TensorFlow as open source
2015 · follows
A
Attention Is All You Need Paper Presentation at NIPS 2017
2017 · follows