Batch-wise Adaptive Pruning for Large Reasoning Models
August 17, 2026
To prevent accuracy collapse during batched inference in LRMs, this new training-free pruning method replaces threshold-based selection with periodic top-k selection over aggregated activations. This maintains the intended sparsity ratio when multiple samples share a single pruning mask.
HOW THIS AFFECTS YOU
●
builderYou can implement more efficient batched inference for reasoning models without losing accuracy.
●
researcherThis addresses a critical failure mode where threshold-based pruning drifts during batch processing.