Needle2 45M Parameter Agentic LLM for Edge Devices
August 10, 2026
Needle2 is a 14MB 45M parameter model using 2-bit compression designed for agentic tool calls and structured extraction. It requires 28MB of RAM and achieves 500 tokens per second on a Raspberry Pi 5.
HOW THIS AFFECTS YOU
●
builderYou can deploy agentic logic and tool use on microcontrollers and low-power wearable hardware.