Engram 2.6B Model Architecture Features 4.3B Parameter Engram Table
September 23, 2026
The Engram model update specifies a 2.6B parameter total size with 2.2B trained parameters and a 4.3B parameter Engram table. The architecture utilizes 3:1 Sliding Window Attention (SWA) layering with 4k/4k/8k context windows followed by a global layer.
HOW THIS AFFECTS YOU
●
researcherYou can analyze the performance implications of using a massive Engram table relative to a smaller trained parameter count.