Data-Efficient Full-Duplex Spoken Dialogue via LLM Adapters
November 13, 2026
A frozen multimodal LLM can be adapted for word-level, full-duplex dialogue using only 97M trainable parameters. The system uses a thinker-talker cascade on an 80 ms frame clock to manage interruptions and backchanneling via new token embeddings.
HOW THIS AFFECTS YOU
●
builderYou can build full-duplex voice agents using frozen LLMs and lightweight adapters instead of training on millions of hours of speech.
●
designerYou can create more natural voice interfaces that allow users to interrupt or receive backchanneling at the word level.