X-AuT reduces speech LLM audio-encoder layers with cross-scale distillation
September 11, 2026
X-AuT uses progressive layer selection and representation alignment to compress audio encoders in speech LLMs. Compressing Qwen3-ASR-0.6B from 18 to 14 layers reduced macro-average error from 5.61% to 5.75% while achieving 20.7% fewer audio-encoder parameters.
HOW THIS AFFECTS YOU
●
builderYou can reduce inference costs for speech-to-text models with minimal impact on accuracy.
●
researcherThe framework demonstrates how cross-scale distillation can mitigate embedding perturbations in pruned encoders.