Successive Capacity Growth for Vision Transformer Encoders
August 28, 2026
Successive Capacity Growth (SCG) dynamically expands ViT width and depth based on task complexity within JEPA world models. It uses a function-preserving expansion mechanism and SIGReg to grow models from minimal configurations while preventing semantic collapse.
HOW THIS AFFECTS YOU
●
researcherYou can optimize compute by starting with minimal encoders and growing them only as needed.