Cypherpunks December 1993
In December 1993, while most of the world was transfixed by the release of Doom and the dawn of the web browser wars, a group of researchers at Bell Labs quietly published a mathematical framework that would predict the exact moment our current AI revolution would start to sputter. They weren't studying artificial intelligence per se - they were studying learning itself, in its most abstract form. The curves they drew weren't just theoretical constructs; they were prophetic sketches of humanity's relationship with knowledge acquisition.
What they discovered was both liberating and sobering: every learning system, whether biological or artificial, follows the same inevitable trajectory. Initial rapid improvement, then a long, frustrating plateau where each additional unit of effort yields progressively smaller gains. The mathematics was elegant - the error rate decreases as a power law of the training set size - but the implications were profound. They had essentially calculated the expiration date of the "bigger is better" approach to AI.
Here's where it gets truly fascinating: the paper appeared precisely 18 years before the deep learning revolution took off in 2012. This 18-year gap mirrors the exact pattern seen with Shannon's information theory (1948) and the birth of the internet (1966), and again with Turing's computability work (1936) and the first commercial computers (1954). It's as if the universe provides mathematical blueprints for its own limitations exactly one generation before we need them.
Today, as we watch companies burn through billions of dollars chasing diminishing returns on larger models, the 1993 paper reads like a message from the past to our future selves. The authors weren't just describing learning curves - they were drawing the boundaries of our current paradigm. And like all good boundaries, they don't just tell us where we are; they hint at what lies beyond.
Sources: Learning Curves Theory Published - Asymptotic Values and Rate of Convergence
Published September 27, 2025