ASSET Framework for Adaptive Speech Token Compression via RL
October 14, 2026
ASSET uses Group-Relative Policy Optimization (GRPO) to train an adaptive segmenter that compresses acoustic encoder outputs into variable-duration segments. In English LibriSpeech experiments, the framework achieved performance comparable to transcript-assisted oracles while reducing audio token counts by approximately 25%.
HOW THIS AFFECTS YOU
●
builderYou can reduce inference costs and latency for speech LLMs by compressing audio input sequences.
●
researcherThis demonstrates how RL can be used to optimize sequence length in multimodal tokenization.