CONNECT WITH US
AI & Deeptech

AI & Deeptech

Nvidia squeezed a 74B agent model into 24GB so it can run on your laptop

TheNewStack (AI) - ArtificialIntelligence logo

Published on

Add as a preferred source on Google
Nvidia squeezed a 74B agent model into 24GB so it can run on your laptop

Nvidia on Thursday announced a few new additions to its Nemotron family: Nemotron 3.5 Super VL, a 120B vision-language model for enterprise agents and two small Bolt models (Nemotron 3.5 Bolt 74B-A9B 24GB and Nemotron 3.5 Bolt E4B 4GB) for running coding, research, and conversational workloads locally.

The Bolt models, Nvidia says, are meant to run “everyday agentic tasks on laptops, balancing speed and intelligence needed to handle multistep reasoning, tool calling, and web browsing.”

And while they come in very different sizes and are meant for different use cases, the focus for all three is on speed and efficiency.

The two larger models are available today, while the smaller Bolt E4B 4G model will launch in the near future.

The marquee release here is Nemotron 3.5 Super VL, a 120-billion-parameter model that combines reasoning and tool use with image and document understanding.

In the announcement, Kari Briski, Nvidia’s VP for open models and software, notes that the large model is meant to deliver “leading accuracy on multimodal agentic tasks — instruction following, tool use, multistep business workflows, and visual understanding — comparable with NVIDIA’s largest reasoning model at roughly one-fifth the parameter count.”

Super VL builds on Nemotron 3 Super , which launched in March. Both have 120 billion total parameters, with 12 billion active during inference, and context windows of up to 1 million tokens. But while the earlier model only accepted text, Super VL now adds support for image and video input (though not output).


Source link

Disclaimer

We strive to uphold the highest ethical standards in all of our reporting and coverage. We TheMorningPulse.fyi want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It's possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.