Kraken S2ST Uses Low-Bitrate VQ for Speech Translation
September 14, 2026
Kraken performs speech-to-speech translation by augmenting Qwen3-8B with low-bitrate tokens derived from single-layer vector quantization. It utilizes an Autowave-X decoder conditioned on source speech to preserve non-linguistic prosody and identity without requiring perfectly aligned training data.
HOW THIS AFFECTS YOU
●
builderYou can achieve better prosody transfer in speech models by using low-bitrate tokens and source-conditioned decoders.
●
researcherThis provides a new method for decoupling linguistic content from speaker identity in S2ST tasks.