PACE: Periodic and Channel-Aligned Encoding of Four-Bit Recurrent States

PACE implements post-hoc four-bit quantization for linear-attention recurrent states by rounding values only once every few tokens rather than per-step. By buffering intermediate tokens to mitigate cumulative rounding error, this method enables higher-density sequence serving on accelerators without requiring model fine-tuning or increased bit-widths.