The causal latent workspace architecture increases computation by reusing Transformer blocks through a shared-depth design with gated vector latent slots. At 101.71M parameters, the model outperforms standard Transformer controls on WikiText-103, enwik8, and TinyStories by improving position-specific summary exchange.
HOW THIS AFFECTS YOU
●
researcherYou can achieve better perplexity at fixed parameter budgets by utilizing content-addressed latent summaries.