Tracing Audio Grounding and Answer Selection in Audio LLMs

Training models on data where answers cannot be inferred from text improves audio grounding by altering internal representation dynamics. Acoustic information most strongly influences answer choice representations in early-to-middle layers, while training increases audio's impact on final predictions within middle-to-late layers.