Pruning Whisper Encoders via Leave-One-Layer-Out WER Analysis
September 22, 2026
This method reduces Whisper encoder size by 18.5% by removing the six layers that cause the least change in Word Error Rate (WER). The approach enables more efficient ASR without requiring the extensive custom inference implementations typical of other pruning methods.
HOW THIS AFFECTS YOU
●
builderYou can deploy faster, lighter Whisper models for transcription with minimal accuracy loss.