Motif-Mamba Improves Long-Range Modeling with Structured SSMs

Motif-Mamba augments the Mamba architecture with a motif-constrained low-rank recurrent pathway to improve cross-dimensional communication. It maintains linear-time complexity while enhancing the model's ability to handle long-sequence extrapolation.