Rust-native OpenRouter alternative with sub-2ms latency overhead

This open-source model gateway unifies self-hosted and frontier models through a single interface. It handles provider-specific quirks like streaming formats, tool calls, and rate limits with under 1ms latency for BYOK requests and under 2ms when using managed keys.