Influence Score for Transformer Interpretability and Prompt Injection Detection
September 7, 2026
An influence score quantifies attention head contributions by combining directional logit influence with residual stream structural impact. Testing on a DeBERTa model for prompt injection detection shows the metric can distinguish decision behaviors between correct and erroneous predictions.
HOW THIS AFFECTS YOU
●
researcherYou can use this multi-scale analysis to bridge the gap between fine-grained circuit analysis and global output methods.