NVIDIA Releases Nemotron 3.5 Bolt E4B: Local Agents on 4GB of VRAM
NVIDIA released Nemotron 3.5 Bolt E4B 4GB on Oct 23, a small open language model for local devices, built for conversation and tool use in voice assistants, game characters and robots.

What happened
Bolt E4B is the final piece of the Nemotron 3.5 family NVIDIA announced Oct 15: Super VL (120 billion parameters) and Bolt 74B-A9B (24GB) were already available, with E4B scheduled for Oct 23. On Oct 23, the NVIDIA AI account posted a demo: a Reachy Mini robot chatting and moving its head and antennas on an 8GB Jetson Orin Nano, with Bolt handling conversation and Cosmos handling vision, both running locally.
Structurally, Bolt E4B has 8 billion total parameters and 4 billion effective parameters, built on Google's open Gemma 4 E4B and post-trained by NVIDIA with reinforcement learning. Weights are a free download from Hugging Face under the OpenMDW-1.1 license, which permits commercial use, and the model runs with llama.cpp or Ollama.
The name needs one clarification: the 4GB in the name refers to NVIDIA's VRAM target, while the actual GGUF download is about 6.18GB and running it needs at least 4 to 5GB of VRAM. NVIDIA positions E4B for fast conversational agents, as distinct from the desktop-class Bolt 74B or the data-center-class Super VL.
Key facts
- On Oct 15 NVIDIA released Nemotron 3.5 Super VL and two Bolt models; Super VL and Bolt 74B-A9B were available then, Bolt E4B was scheduled for Oct 23 and arrived on schedule.
- Bolt E4B has 8 billion total parameters and 4 billion effective parameters, with E standing for effective; it starts from Google's Gemma 4 E4B and was fine-tuned by NVIDIA with reinforcement learning.
- Target uses are local voice assistants, interactive characters and robots that converse and use tools; in the demo, Reachy Mini ran locally on an 8GB Jetson Orin Nano, with Bolt handling conversation and Cosmos handling vision.
- Weights are a free Hugging Face download under OpenMDW-1.1, which permits commercial use; it runs via llama.cpp or Ollama, with a GGUF file of about 6.18GB.
- Family roles: Lightning targets high throughput, Ultra targets the hardest reasoning tasks, Super VL targets always-on agents, and Bolt targets edge and local devices.
Why it matters
the Nemotron family now spans data center, desktop and edge tiers, and E4B is the smallest tier, fitting conversation and tool use into a 4GB-VRAM device.
Comments
Related
- Oct 13NVIDIA Releases Nemotron 3.5 Bolt 74B: A Local-Agent Model Packed Into 24GB
- Oct 8White House Announces $2.4B in AI-for-Science Tool and Compute Credit Pledges From 11 Companies
- Oct 22DeepSeek Open-Sources DeepInfer, the Inference Engine Behind Its Production Services
- Oct 20doubleAI Launches "Code Execution Model" Maxwell With Nvidia Backing; First Customer Cut Compute Costs 67%
- Oct 16StepFun Releases Step-5 Preview Open Weights: 600B Parameters on Hugging Face
Today
Oct 24 Saturday- Brief
- GitHubGitHub Weekly Vol.2: 6 Projects Worth Your Time
Tested or read — weeklyAll →
- Quiz
- Call
Latest news
All →- Oct 241Password Launches Agents Platform: Agent Logins Without Handling Passwords
- Oct 24iFLYTEK Launches Agent OS and Xingchen TaaS: Agents Move From Model Calls to Business Loops
- Oct 24Moonshot Releases Kimi K3.1 Pro: 3-Trillion-Parameter-Class Open-Weight Model, Deliberately Curbed Cyber Capabilities
- Oct 24Block Unveils Dessa, a Voice Model That Learned to Talk from Speech Alone
- Oct 24Texas Sues OpenAI and Altman: the Tenth State Suit, and the CEO Is a Defendant
- Oct 24PHP2Shell Flaws "Broadly Exploited": Amazon Says Attacks Began Four Days Before Patches
™