Progressive Error Curriculum Training Improves Phoneme-to-Text Reconstruction in Visual Speech

The PECT framework adapts NLLB-based reconstruction models by progressively introducing realistic phoneme prediction errors. This curriculum learning approach addresses the mismatch between clean synthetic training data and noisy phoneme sequences encountered during visual speech recognition inference.