Causal Grassmann Layers as an Attention-Free Alternative
October 25, 2026
This architecture replaces multi-head attention with Grassmann flows, encoding local token pairs as two-dimensional subspaces on a Grassmann manifold using Plucker coordinates. The method seeks to avoid the mathematical opacity of high-dimensional tensor lifting found in standard attention mechanisms.
HOW THIS AFFECTS YOU
●
researcherYou can explore non-attention-based architectures that rely on geometric manifolds for sequence modeling.