Nemotron 3.5 Super VL and Bolt: a 120B server model and a 24GB local agent model

Super VL is a multimodal MoE with 120B parameters, 12B active, built for always-on agents that read web pages, PDFs, tables and charts and call tools. Bolt 74B-A9B uses native 2-bit quantization to fit in 24GB, so it can run local agents on an RTX PC or DGX Spark; a 4GB Bolt E4B follows on Oct 23. Weights are on Hugging Face, OpenRouter and NVIDIA NIM, and Bolt works with llama.cpp, Ollama and LM Studio.

llama-server -hf nvidia/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-24GB-GGUF

NVIDIA says it's up to 5x fasterVendor claim than other open models in its class, a big deal if your agents chew through piles of documents. The training datasets and recipes are public too, so post-training on your own data is easier, and NVIDIA says Atlassian, CrowdStrike and Perplexity are already customizing it. Bolt ranks first in its class on PinchBenchVendor claim, which makes it worth a try for work you'd rather keep on a laptop than send to the cloud.