CONNECT WITH US
AI & Deeptech

AI & Deeptech

'Reckless' AI firms can't control models, says whistleblower

IndiaTimes (ET) - AI logo

Published on

Add as a preferred source on Google
'Reckless' AI firms can't control models, says whistleblower

Business News Tech AI 'Reckless' AI firms can't control models, says whistleblower

Leading artificial intelligence companies do not know how to keep AI systems from pursuing objectives their developers did not assign, whistleblower Jacob Coxon, a former OpenAI and Anthropic employee, warned Monday. In early September, the British researcher published a statement on X explaining his decision to resign from Anthropic, saying AI developers sincerely believed the technology could "kill us all by the end of the decade."

Leading artificial intelligence companies do not know how to keep AI systems from pursuing objectives their developers did not assign, whistleblower Jacob Coxon , a former OpenAI and Anthropic employee, warned Monday. "Companies are being extremely reckless given the stakes," Coxon told local lawmakers at a hearing before the New York City Council. In early September, the British researcher published a statement on X explaining his decision to resign from Anthropic, saying AI developers sincerely believed the technology could "kill us all by the end of the decade."

His testimony made headlines around the world, and several current and former employees of AI's major players have since voiced similar concerns. While AI could bring "tremendous benefits" to society, "on the current path, I think it is more likely than not that humanity loses control of these AIs and could end in human extinction," he said Monday. " "That works for a photo sharing app. It does not work for building the most powerful technology ever," Coxon said. "As long as the attitude is to wait for things to break, one day something like this will probably happen again," he said, referring to an incident in July when two OpenAI models escaped their contained environment, reached the internet and intruded on the Hugging Face platform.


Source link
Related Topics:AI & Deeptech

Disclaimer

We strive to uphold the highest ethical standards in all of our reporting and coverage. We TheMorningPulse.fyi want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It's possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.