Dory1.0-4B: A Looped Normalized-GPT

Dory1.0-4B uses a normalized Transformer backbone with a recurrent block that allows variable inference depth from a single checkpoint. Pre-trained on 6 trillion tokens with a 256K context window, the model utilizes a difficulty-aware curriculum to improve accuracy on coding and agentic tasks by increasing loop counts for complex prompts.