Training-Free Discovery of Stylistic Axes via PCA on Activations
September 18, 2026
A new method uses high-temperature sampling and Principal Component Analysis on pooled hidden activations to discover stylistic dimensions without supervised training. On Qwen-3.5-4B-Instruct, the top two axes achieved 72.8% precision in matching human-elicited stylistic annotations.
HOW THIS AFFECTS YOU
●
builderThis technique could enable more precise, activation-based control over model style during inference.
●
researcherYou can now identify latent stylistic structures in models without needing contrastive datasets.