ALPHA Timepoint is in alpha Talk to Us
AlexNet Wins the ImageNet Challenge

AlexNet Wins the ImageNet Challenge

Alex Krizhevsky, Ilya Sutskever, and Geoffrey Hinton's deep convolutional neural network "AlexNet" wins the ImageNet Large Scale Visual Recognition Challenge (ILSVRC 2012) with a top-5 error rate of 15.3%, obliterating the runner-up's 26.2% by an unprecedented 10.8 percentage-point margin. Trained on two NVIDIA GTX 580 GPUs for six days, the 8-layer, 60-million-parameter network demonstrated that deep neural networks trained with backpropagation on GPUs could vastly outperform decades of hand-engineered computer vision features. The result — announced at ECCV 2012 in Florence and presented as a paper at NeurIPS 2012 in Lake Tahoe — is widely regarded as the "Big Bang" of the modern deep learning era. It triggered an avalanche of GPU-accelerated neural network research, convinced industry that deep learning worked at scale, and set in motion the chain of advances through ResNets, GANs, sequence models, and ultimately the Transformer architectures that produced modern large language models. Cited over 150,000 times, it remains one of the most consequential papers in computer science history.

Year 2012
Date 10/7
Location Florence, Tuscany, Italy
Layer 1
Visibility PUBLIC
artificial-intelligence deep-learning computer-vision neural-networks gpu-computing imagenet machine-learning

Key Figures

Alex Krizhevsky Ilya Sutskever Geoffrey Hinton

Causal neighbors · 161 linked moments

I
ImageNet: A Large-Scale Hierarchical Image Database
2009 · same era
I
ImageNet: A Large-Scale Hierarchical Image Database
2009 · precedes
I
ImageNet: A Large-Scale Hierarchical Image Database
2009 · thematic
I
ImageNet: A Large-Scale Hierarchical Image Database
2009 · causes
Minsky & Papert Publish "Perceptrons"
Minsky & Papert Publish "Perceptrons"
1969 · thematic
Rosenblatt Demonstrates the Perceptron
Rosenblatt Demonstrates the Perceptron
1958 · thematic
Rosenblatt Demonstrates the Perceptron
Rosenblatt Demonstrates the Perceptron
1958 · influences
Hinton Publishes "A Fast Learning Algorithm for Deep Belief Nets"
Hinton Publishes "A Fast Learning Algorithm for Deep Belief Nets"
2006 · same era
Hinton Publishes "A Fast Learning Algorithm for Deep Belief Nets"
Hinton Publishes "A Fast Learning Algorithm for Deep Belief Nets"
2006 · precedes
Hinton Publishes "A Fast Learning Algorithm for Deep Belief Nets"
Hinton Publishes "A Fast Learning Algorithm for Deep Belief Nets"
2006 · same figure
Hinton Publishes "A Fast Learning Algorithm for Deep Belief Nets"
Hinton Publishes "A Fast Learning Algorithm for Deep Belief Nets"
2006 · thematic
Hinton Publishes "A Fast Learning Algorithm for Deep Belief Nets"
Hinton Publishes "A Fast Learning Algorithm for Deep Belief Nets"
2006 · influences
Backpropagation Paper Published in Nature
Backpropagation Paper Published in Nature
1986 · same figure
AlphaGo Move 37
AlphaGo Move 37
2016 · thematic
Dartmouth Summer Research Project on Artificial Intelligence
Dartmouth Summer Research Project on Artificial Intelligence
1956 · thematic
Backpropagation Paper Published in Nature
Backpropagation Paper Published in Nature
1986 · thematic
Deep Blue Defeats Garry Kasparov
Deep Blue Defeats Garry Kasparov
1997 · thematic
Turing Publishes "Computing Machinery and Intelligence"
Turing Publishes "Computing Machinery and Intelligence"
1950 · thematic
Publication of "Attention Is All You Need"
Publication of "Attention Is All You Need"
2017 · thematic
S
Space Shuttle Columbia Disaster
2003 · same era
S
Space Shuttle Columbia Disaster
2003 · precedes
S
Space Shuttle Columbia Disaster
2003 · same era
S
Space Shuttle Columbia Disaster
2003 · precedes
C
Columbia Accident Investigation Board Report Release
2003 · same era
C
Columbia Accident Investigation Board Report Release
2003 · precedes
S
Space Shuttle Discovery STS-114 Return to Flight
2005 · same era
S
Space Shuttle Discovery STS-114 Return to Flight
2005 · precedes
S
STS-107 Launch
2003 · same era
S
STS-107 Launch
2003 · precedes
S
STS-114 Return to Flight
2005 · same era
S
STS-114 Return to Flight
2005 · precedes
C
Columbia Accident Investigation Board Report Release
2003 · same era
C
Columbia Accident Investigation Board Report Release
2003 · precedes
S
Space Shuttle Columbia Disaster
2003 · same era
S
Space Shuttle Columbia Disaster
2003 · precedes
S
Space Shuttle Discovery Return to Flight (STS-114)
2005 · same era