MoE Framework Preserves Speaker Identity Across Verbal and Non-Verbal TTS Output

A speaker verification system combining frozen Data2Vec features with ECAPA-TDNN and a Mixture of Experts routing module maintains identity consistency across 10 non-verbal vocalization types without catastrophic forgetting of speech performance. Conditional distillation from a pretrained teacher and a contrastive loss bridge the speech-NVV domain gap.