Frontier LLMs design sparse lookup tables outperforming transformers on ARC
November 18, 2026
Three frontier models independently designed sparse lookup table architectures instead of transformers when tasked with designing a neural network without gradient descent.
HOW THIS AFFECTS YOU
●
builderYou might be able to build much smaller, faster models for specific reasoning tasks like ARC.
●
researcherYou can see how frontier models approach architecture design when gradient descent is removed from the loop.