Spiking Contrastive Attention Mitigates Spectral Bias in Spiking Transformers
October 2, 2026
Spiking Contrastive Attention (SCA) addresses the low-pass filtering effect of spiking neurons that dissipates high-frequency information. By using global contrastive aggregation and local differential refinement, SCA enhances high-frequency component retention in spiking architectures.
HOW THIS AFFECTS YOU
●
researcherYou can utilize this paradigm to bridge the performance gap between spiking and artificial neural networks.