Spectral Smoothing Reconfigures LLM Capability and Safety Profiles
October 23, 2026
Post-hoc interventions on transformer feed-forward matrices can manipulate LLM performance by altering singular-value spectra. Applying spectral smoothing or spiking to up_proj and down_proj matrices allows for targeted shifts in factual knowledge, reasoning, and safety without changing singular vectors.
HOW THIS AFFECTS YOU
●
researcherThis provides a new mechanism for post-hoc model steering and capability profile adjustment via matrix surgery.