HyQuant Hybrid-Precision Quantization for Attention Modules

HyQuant is a hybrid quantization framework that reduces LLM attention error by keeping critical vertical-line tokens and local-window states in high precision. It uses lightweight pattern signals to balance efficiency and accuracy at low bit-widths.