SpectralShift for Long-Context Gated DeltaNet Extension
September 12, 2026
SpectralShift extends the context window of Gated DeltaNet through spectral reparameterization. It targets the preservation of slow spectral bands for long-range retrieval and fast-decaying modes for context switching in linear attention layers.
HOW THIS AFFECTS YOU
●
researcherThis provides a method to extend linear attention context without relying solely on continued pretraining.