Linear Superposition Enables Simultaneous LLM Thought Generation
September 25, 2026
The Superposition Linearity Hypothesis demonstrates that Transformers can output a superposition of individual next-token distributions when inputs are linearly combined. Lightweight fine-tuning can restore this linearity, and a new guided decoding procedure allows for the disentanglement of two coherent concurrent outputs.
HOW THIS AFFECTS YOU
●
builderYou may be able to use guided decoding to implement more efficient, multi-stream generation patterns.
●
researcherThis provides evidence that linearity is an intrinsic architectural property rather than an emergent training effect.