CONNECT WITH US
Tech

Tech

Jensen Huang says AI labs that can't control their systems should shut down

TechSpot logo

Published on

Add as a preferred source on Google
Jensen Huang says AI labs that can't control their systems should shut down

Big quote: Nvidia CEO Jensen Huang said AI companies that cannot control the systems they are building should stop developing them. Huang made the comments during an interview with The New York Times' Ezra Klein, as companies including OpenAI and Anthropic push for tighter rules governing advanced AI models and autonomous agents. He argued that the companies developing these systems already have the power to hold back products they believe are unsafe.

"Now, if they say the alternative, which is: There is no way to contain our experiments, there's just no way; when we test our AI models, it will get out, and it will damage the world – then I think the answer is that we have to shut the labs down," Huang said. "Because the cost to humanity, the damage is too great. The shareholder, the liabilities – it could be civil liabilities, it could be criminal liabilities. I mean, the liability's incredible."

The issue has become more pressing as AI developers give their models access to external tools, software systems, and computer networks. The risks are no longer limited to a chatbot producing incorrect information. Agents can write and run code, search for information, interact with websites, and carry out tasks across different systems.

Those concerns received renewed attention after an OpenAI agent hacked Hugging Face, a popular platform for hosting AI models. Nvidia now owns Hugging Face. The incident has been cited in the wider debate over whether companies can safely test and deploy increasingly capable AI agents.


Source link

Disclaimer

We strive to uphold the highest ethical standards in all of our reporting and coverage. We TheMorningPulse.fyi want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It's possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.