← October 14, 2026 briefing · added in the 00:00 KST update
NVIDIA said to release 'Nemotron Bolt 3.5 74B-A9B' on Oct. 15, a MoE model fit into 24GB via 2-bit quantization (community report)
Announced October 14, 2026
Verified (fact)
According to a Reddit r/LocalLLaMA post, NVIDIA plans to release 'Nemotron Bolt 3.5 74B A9B' on October 15. It is described as a MoE model with 74B total parameters and 9B active parameters, quantized to 2 bits to fit into 24GB while maintaining quality through quantization-aware training (QAT). The post also said a 4GB model, 'Nemotron 3.5 Bolt E4B,' is scheduled for release on October 23. The collected materials include no official NVIDIA announcement.
Needs fact-check (claim)
The post says the model is faster than most popular dense models with similar memory use and outperforms most MoE models of similar size.
Why it matters (interpretation)
If true, a 70B-class MoE model could run on a single 24GB consumer GPU. It would be a test of whether extreme low-bit quantization is becoming practical for local inference.
Confidence low · official source pending
Sources
- Community NVIDIA Nemotron Bolt 3.5 74B A9B releases Oct. 15th Reddit
More about NVIDIA
-
NVIDIA cites $250 million, five-year compute commitment to strengthen agentic safety in the UK
In an official blog post highlighting adoption across the UK AI ecosystem, NVIDIA mentioned a five-year, $250 million compute commitment...
-
NVIDIA takes stakes in four French startups as Jensen Huang pledges $2 billion for European acquisitions and investments (report)
NVIDIA is taking stakes in French startups Doctolib, Genesis AI, Entalpic, and Pigment. CEO Jensen Huang, who is touring Europe, said on...
-
AWS details MoE kernel optimizations in SageMaker AI: up to 10% higher throughput and 9% faster TTFT on H200
AWS engineers published kernel optimization techniques for fused MoE (Mixture-of-Experts) models. They include Swap-AB to raise WGMMA...
-
NVIDIA shows how to use AI agents to rewrite Apache Spark UDFs for GPU acceleration
An NVIDIA developer blog post explained how to use AI agents to rewrite Apache Spark UDFs (user-defined functions) for GPU acceleration....
-
Microsoft to deploy its in-house Maia AI chips at multi-GW scale from next year; Maia 300 volume deployment in 2027 (reported)
On October 12 (local time), CEO Satya Nadella said on X and the official blog that Microsoft is making its largest-ever investment in...