HRM SSM Adapter Beats LoRA on Long-Context Tasks with Mistral-7B

The Hankel Reduced-order Model (HRM) adapter is an SSM-based PEFT module initialized via Balanced Truncation, using FFT-based parallel scan to match LoRA compute at all context lengths. On Mistral-7B with 8.4M trainable parameters, it achieves +34.8% relative accuracy on QuALITY and +71.6% relative ROUGE-1 on QMSum versus LoRA variants.