ALPHA Timepoint is in alpha Talk to Us
Sign In Get Started
Backpropagation Paper Published in Nature

Backpropagation Paper Published in Nature

Rumelhart, Hinton, and Williams publish "Learning representations by back-propagating errors" in Nature (vol. 323, pp. 533-536), demonstrating that multi-layer neural networks can learn useful internal representations by propagating error gradients backward through hidden layers — overcoming the limitations of single-layer perceptrons identified by Minsky and Papert in 1969 and reigniting the connectionist revolution that would eventually produce modern deep learning

Year 1986
Date 10/9
Location La Jolla, California, United States
Layer 2
Visibility PUBLIC
artificial-intelligence neural-networks deep-learning machine-learning computer-science cognitive-science

Key Figures

David Rumelhart Geoffrey Hinton Ronald Williams
Time Travel

Causal neighbors · 337 linked moments

Minsky & Papert Publish "Perceptrons"
Minsky & Papert Publish "Perceptrons"
1969 · thematic
I
ImageNet: A Large-Scale Hierarchical Image Database
2009 · thematic
I
ImageNet: A Large-Scale Hierarchical Image Database
2009 · follows
Rosenblatt Demonstrates the Perceptron
Rosenblatt Demonstrates the Perceptron
1958 · thematic
Rosenblatt Demonstrates the Perceptron
Rosenblatt Demonstrates the Perceptron
1958 · influences
Minsky & Papert Publish "Perceptrons"
Minsky & Papert Publish "Perceptrons"
1969 · influences
Shannon Publishes "A Mathematical Theory of Communication"
Shannon Publishes "A Mathematical Theory of Communication"
1948 · thematic
Shannon Publishes "A Mathematical Theory of Communication"
Shannon Publishes "A Mathematical Theory of Communication"
1948 · influences
Hinton Publishes "A Fast Learning Algorithm for Deep Belief Nets"
Hinton Publishes "A Fast Learning Algorithm for Deep Belief Nets"
2006 · same figure
Hinton Publishes "A Fast Learning Algorithm for Deep Belief Nets"
Hinton Publishes "A Fast Learning Algorithm for Deep Belief Nets"
2006 · thematic
Turing Publishes "Computing Machinery and Intelligence"
Turing Publishes "Computing Machinery and Intelligence"
1950 · thematic
Turing Publishes "Computing Machinery and Intelligence"
Turing Publishes "Computing Machinery and Intelligence"
1950 · influences
Hinton Publishes "A Fast Learning Algorithm for Deep Belief Nets"
Hinton Publishes "A Fast Learning Algorithm for Deep Belief Nets"
2006 · follows
Publication of "Attention Is All You Need"
Publication of "Attention Is All You Need"
2017 · thematic
Publication of "Attention Is All You Need"
Publication of "Attention Is All You Need"
2017 · caused by
AlexNet Wins the ImageNet Challenge
AlexNet Wins the ImageNet Challenge
2012 · same figure
AlexNet Wins the ImageNet Challenge
AlexNet Wins the ImageNet Challenge
2012 · thematic
AlphaGo Move 37
AlphaGo Move 37
2016 · thematic
Deep Blue Defeats Garry Kasparov
Deep Blue Defeats Garry Kasparov
1997 · thematic
Dartmouth Summer Research Project on Artificial Intelligence
Dartmouth Summer Research Project on Artificial Intelligence
1956 · thematic
AlexNet Wins the ImageNet Challenge
AlexNet Wins the ImageNet Challenge
2012 · caused by
R
Rogers Commission Report Release
1986 · same era
S
Space Shuttle Challenger Disaster
1986 · same era
S
Space Shuttle Challenger Disaster
1986 · precedes
S
Space Shuttle Challenger Disaster
1986 · precedes
R
Rogers Commission Report Release
1986 · precedes
S
Space Shuttle Discovery STS-26 Return to Flight
1988 · same era
S
Space Shuttle Discovery STS-26 Return to Flight
1988 · follows
S
Space Shuttle Challenger Disaster
1986 · same era
S
Space Shuttle Challenger Disaster
1986 · precedes
E
Establishment of the Rogers Commission
1986 · same era
E
Establishment of the Rogers Commission
1986 · precedes
S
Space Shuttle STS-26 Return to Flight Launch
1988 · same era
S
Space Shuttle STS-26 Return to Flight Launch
1988 · follows
S
Space Shuttle Challenger Disaster
1986 · same era
S
STS-1 (First Flight of Space Shuttle Columbia)
1981 · same era