Word Encoding Reduces Silent Errors in Sub-Billion Parameter Parsers
November 13, 2026
Using word-based encoding for semantic parsing reduces silent error rates by 2.3x on Qwen3.5-0.8B and 1.8x on LFM2.5-350M compared to s-expressions. While shortening output does not improve accuracy, word encoding achieves 87.5% exact match on Qwen while using 4.1x fewer tokens.
HOW THIS AFFECTS YOU
●
builderYou can get more reliable parsing from tiny models by using natural words instead of code-like formats.
●
researcherThis shows that output format is a critical lever for controlling error rates in small-scale semantic parsing.