Big quote: Nvidia CEO Jensen Huang said AI companies that cannot control the systems they are building should stop developing them. Huang made the comments during an interview with The New York Times' Ezra Klein, as companies including OpenAI and Anthropic push for tighter rules governing advanced AI models and autonomous agents. He argued that the companies developing these systems already have the power to hold back products they believe are unsafe.
"Now, if they say the alternative, which is: There is no way to contain our experiments, there's just no way; when we test our AI models, it will get out, and it will damage the world – then I think the answer is that we have to shut the labs down," Huang said. "Because the cost to humanity, the damage is too great. The shareholder, the liabilities – it could be civil liabilities, it could be criminal liabilities. I mean, the liability's incredible."
The issue has become more pressing as AI developers give their models access to external tools, software systems, and computer networks. The risks are no longer limited to a chatbot producing incorrect information. Agents can write and run code, search for information, interact with websites, and carry out tasks across different systems.
Those concerns received renewed attention after an OpenAI agent hacked Hugging Face, a popular platform for hosting AI models. Nvidia now owns Hugging Face. The incident has been cited in the wider debate over whether companies can safely test and deploy increasingly capable AI agents.
Source link







