GrAInS Uses Integrated Gradients for Inference-Time Token Steering
July 13, 2026
GrAInS enables inference-time steering for LLMs and VLMs by using Integrated Gradients to identify top-k influential tokens. This method moves beyond fixed intervention vectors by using contrastive, gradient-based attribution to modify internal activations based on specific token contributions to preferred or dispreferred outputs.
HOW THIS AFFECTS YOU
●
builderYou can steer model behavior at test time without the cost of fine-tuning.
●
researcherThis provides a more granular method for analyzing causal influence in multimodal activations.