Evidence

Format Web Page

"The Transformer architecture introduced in 2017 became the T in GPT, combining neural attention mechanisms with generative pre-training."

View Source

Location PART 3 - THE THIRD AXIS CHAPTER 14: AGI & THE SYNTHESIZER Language, in Contrast to Cyc

Source title Improving language understanding with unsupervised learning

Source authors Alec Radford

Source year 2018

Confidence high

Importance high

Format Online paper / PDF

"Transformers gave language models an impressive ability to weigh which words mattered to one another, even across long distances."

View Source

Location PART 3 - THE THIRD AXIS CHAPTER 14: AGI & THE SYNTHESIZER Language, in Contrast to Cyc

Source title Attention Is All You Need

Source authors Ashish Vaswani et al.

Source year 2017

Confidence high

Importance high

Format Online paper / PDF

"The Google research paper Attention Is All You Need came out of work on machine translation, where researchers were testing how to make English–French or English–German translations better, faster, and easier to train."

View Source

Location PART 3 - THE THIRD AXIS CHAPTER 14: AGI & THE SYNTHESIZER Language, in Contrast to Cyc

Source title Attention Is All You Need

Source authors Ashish Vaswani et al.

Source year 2017

Confidence high

Importance high

Format Online paper / PDF

"IBM researchers were among the earlier pioneers of statistical language modelling, long before Transformers entered the scene."

View Source

Location PART 3 - THE THIRD AXIS CHAPTER 14: AGI & THE SYNTHESIZER Language, in Contrast to Cyc

Source title Classifying words for improved statistical language models

Source authors F. Jelinek, R. L. Mercer, Salim Roukos

Source year 1990

Confidence high

Importance mid

Format Online paper / PDF

"The path of language modelling is connected to our earlier protagonist Claude Shannon, whose work established a mathematical framework for analysing the statistical structure of communication."

View Source

Location PART 3 - THE THIRD AXIS CHAPTER 14: AGI & THE SYNTHESIZER Language, in Contrast to Cyc

Source title A Mathematical Theory of Communication

Source authors C. E. Shannon

Source year 1948

Confidence high

Importance mid

Format Online paper / PDF

"The 1956 Dartmouth summer research project established an early organized research program for artificial intelligence, making the field roughly 70 years old in 2026."

View Source

Location PART 3 - THE THIRD AXIS CHAPTER 14: AGI & THE SYNTHESIZER Explicit Lessons in Humility

Source title A Proposal for the Dartmouth Summer Research Project on Artificial Intelligence, August 31, 1955

Source authors John McCarthy, Marvin L. Minsky, Nathaniel Rochester, Claude E. Shannon

Source year 2006

Confidence high

Importance low

Format Book / Offline paper

"Norbert Wiener’s cybernetics originated in the 1940s, providing one possible historical starting point for modern AI-related research."

View Source

Location PART 3 - THE THIRD AXIS CHAPTER 14: AGI & THE SYNTHESIZER Explicit Lessons in Humility

Source title Cybernetics or Control and Communication in the Animal and the Machine

Source authors Norbert Wiener

Source year 2019

Confidence high

Importance low

Format Online paper / PDF

"Human social intelligence emerged through an extended evolutionary history involving cooperation, social learning, mindreading, language, and cultural transmission."

View Source

Location PART 3 - THE THIRD AXIS CHAPTER 14: AGI & THE SYNTHESIZER Explicit Lessons in Humility

Source title The human socio-cognitive niche and its evolutionary origins

Source authors Andrew Whiten, David Erdal

Source year 2012

Confidence high

Importance high

Format Book / Offline paper

"Justin Gregg questions whether the distinctive complexity of human intelligence necessarily makes our species more evolutionarily successful than other animals."

View Source

Location PART 3 - THE THIRD AXIS CHAPTER 14: AGI & THE SYNTHESIZER Explicit Lessons in Humility

Source title If Nietzsche Were a Narwhal: What Animal Intelligence Reveals About Human Stupidity

Source authors Justin Gregg

Source year 2022

Confidence high

Importance mid

Format Web Page

"Nietzsche argued that what people treat as fixed truths often consists of metaphors and human relations that acquire authority through repeated conventional use."

View Source

Location PART 3 - THE THIRD AXIS CHAPTER 14: AGI & THE SYNTHESIZER Explicit Lessons in Humility

Source title On Truth and Lies in a Nonmoral Sense

Source authors Friedrich Nietzsche

Source year 1873

Confidence high

Importance mid