NVIDIA Nemotron 3.5 Bolt 74B-A9B VLM for 24GB Local Deployment
October 15, 2026
NVIDIA released a 74B parameter vision-language model with 9B active parameters using a Mamba-2-Transformer hybrid LatentMoE architecture. Native 2-bit quantization enables the model to fit into 24GB of memory for local agentic tasks while optimizing intelligence per GB.
HOW THIS AFFECTS YOU
●
builderYou can deploy high-parameter VLM capabilities on consumer-grade 24GB GPUs for local agentic workflows.
●
founderYou can reduce inference costs and latency by running smarter models on local edge hardware.