Transformer model arXiv submission

A team of Google Brain researchers is submitting the groundbreaking 'Attention Is All You Need' paper to arXiv, introducing the Transformer model that will revolutionize neural network architecture.

Setting

Google Brain office in Mountain View, California, a modern open-plan workspace with glass walls, ergonomic furniture, and whiteboards covered in equations and diagrams. The area is filled with workstations, monitors, and collaborative spaces.

Characters

The figures in this scene as an entity network — co-presence links everyone in the moment; speakers who trade lines are bound tighter. Turn the resolution dial to reveal depth the engine actually computed.

TNGF

SELECTED

Lead Researcher

primary

A middle-aged man in his late 30s with a lean build, short dark hair slightly tousled from hours of work, and sharp, focused eyes behind rectangular glasses. His face shows signs of fatigue but also determination, with faint lines of concentration between his brows.

Junior Researcher

primary

A young, enthusiastic researcher in their late 20s, with a lean build and slightly tousled hair from long hours at the desk. Their eyes are bright with excitement, and they have a habit of pushing up their glasses when deep in thought.

Data Scientist

secondary

A mid-30s individual with a lean build, wearing rectangular glasses that reflect the glow of multiple monitors. Their dark brown hair is slightly tousled from hours of focused work, and their eyes are sharp, accustomed to scanning complex data visualizations.

Software Engineer

secondary

A late-20s to early-30s male with a lean build, short dark hair, and glasses. His face shows signs of prolonged screen time with slight dark circles under his eyes, but his expression is alert and focused. He has a habit of tapping his fingers when thinking.

Lab Assistant

background

A young adult in their mid-20s, with a slim build and an attentive demeanor. They have short, neatly styled hair and wear glasses that slightly magnify their keen eyes. Their posture is upright but relaxed, reflecting their supportive role in the team.

Dialog

Lead Researcher Let’s ensure the ablation studies are clear—this section needs to show why the recurrent layers aren’t necessary.

Junior Researcher Right! The parallelization gains alone should make that obvious, but maybe we should add a comparative runtime graph?

Software Engineer Uh—she’s throwing dimension mismatches on the multi-head attention outputs again. Did we update the masking logic?

Lead Researcher Check the positional encoding—it should handle variable sequence lengths. If it persists, we’ll need to patch before submission.

Junior Researcher This is huge—the entire field’s going to pivot on this. Do you think they’ll grasp the implications right away?

Lead Researcher If they don’t, the benchmarks will convince them. Attention is all you need—the title says it all.

Software Engineer Fixed it. She’s green across all tests. Ready when you are.

Chat with Characters

Coordinates

Year: 2017
Date: 6/12
Location: Google Brain, California, United States
Layer: 2
Fingerprint: 950d888a4bd2...

Download data

Causal neighbors · 385 linked moments

Release of "Attention Is All You Need" (Transformer) paper

                    2017
                     · contemporaneous
                

Publication of "Attention Is All You Need"

                    2017
                     · contemporaneous
                

Release of the Transformer paper "Attention is All You Need"

                    2017
                     · contemporaneous
                

Publication of "Attention Is All You Need" (2017)

                    2017
                     · contemporaneous
                

First point-contact transistor demonstration

                    1947
                     · same figure
                

Invention of the planar process by Jean Hoerni

                    1959
                     · same figure
                

First point-contact transistor invention

                    1947
                     · same figure
                

Facebook releases PyTorch as open source

                    2016
                     · same figure
                

Manchester Mark 1 First Run

                    1949
                     · same figure
                

Manchester Baby First Run

                    1948
                     · same figure
                

Moore's Law paper published

                    1965
                     · same figure
                

First ARPANET Message Sent

                    1969
                     · same figure
                

First point-contact transistor demonstrated

                    1947
                     · same figure
                

Manchester Baby First Run

                    1948
                     · same figure
                

AlphaGo research published in Nature

                    2016
                     · same figure
                

Manchester Baby runs first stored-program program

                    1948
                     · same figure
                

First Run of the Manchester Baby

                    1948
                     · same figure
                

Invention of the Transistor

                    1947
                     · same figure
                

Invention of the Point-Contact Transistor

                    1947
                     · same figure
                

Invention of the Junction Transistor

                    1948
                     · same figure
                

Invention of the Integrated Circuit

                    1958
                     · same figure
                

UK Lighthill Report criticizes AI research

                    1973
                     · same figure
                

First Website Goes Live at CERN

                    1991
                     · same figure
                

Invention of the Point-Contact Transistor

                    1947
                     · same figure
                

Release of BERT Paper

                    2018
                     · same figure
                

First Silicon Transistor Developed

                    1954
                     · same figure
                

Establishment of the MIT Artificial Intelligence Laboratory

                    1959
                     · same figure
                

First Integrated Circuit Demonstration

                    1958
                     · same figure
                

First Laser Demonstration

                    1960
                     · same figure
                

Invention of the transistor

                    1947
                     · same figure
                

First demonstration of a working integrated circuit by Jack Kilby

                    1958
                     · same figure
                

Google.com domain registered

                    1997
                     · same figure
                

MOSFET invention

                    1959
                     · same figure
                

GPT-3 Paper arXiv Submission

                    2020
                     · same figure
                

First public release of Keras

                    2015
                     · same figure
                

Morris worm released

                    1988
                     · same figure
                