StreamAlign: Streaming Text-Aligned Speech Tokenization

StreamAlign enables real-time, text-aligned speech tokenization by combining character-level RNN-Transducer alignment with word-level ASR guidance. A proactive word boundary classifier anticipates completions at chunk boundaries to reduce latency. This framework mitigates vocabulary mismatch between ASR and LLMs while maintaining acoustic granularity for streaming speech-text joint modeling.