First Passage Attention for Selective Context Erasure

First Passage Attention (FPA) uses path extrema instead of monotonic summation to allow transformers to selectively erase intermediate context while preserving older, structurally relevant tokens.