LENS Method Decomposes Vision-Language Model Activations via Local Low-Rank Neighborhoods

LENS uses a Mixture of Factor Analyzers to decompose VLM activations into local low-rank Gaussian neighborhoods. Applied to LLaVA-1.5-7B and Qwen3-VL-8B, the method identifies distinct modality fusion trajectories, such as Qwen3-VL's early mixing and late-stage recombination.