Agnes-3.0-Flash 33B uses hybrid-attention for long context

Agnes-3.0-Flash 33B uses a hybrid-attention decoder architecture where 75% of layers utilize a gated delta rule for recurrent state management. This approach limits KV cache growth to only 18 of the 72 layers, supporting a 262,144-token context window with multimodal capabilities.