March 10, 20267 min readLATEST
A Holiday Accident That Quietly Broke Machine Learning's Oldest Rule
OpenAI researchers accidentally left a model training over the holidays. When they came back, a model that had completely failed on unseen data now understood everything perfectly. This is the story of grokking—and why it quietly broke several rules we thought were permanent.
Read article