baseVultra: Compact recurrent cell with reallocated capacity
October 23, 2026
The baseVultra architecture concentrates recurrent computation into a single dense candidate-generation matrix while using O(H) diagonal interactions for gates. On TinyShakespeare, it achieved a 1.594 validation loss, outperforming parameter-matched LSTM and GRU models.
HOW THIS AFFECTS YOU
●
researcherThis study suggests that reallocating the recurrent budget from gates to candidate generation improves efficiency in streaming models.