CONNECT WITH US
Tech

Tech

OpenAI, Anthropic Prepare For Backlash Over Potential AI Catastrophe: Report

Inc42 - All News logo

Published on

Add as a preferred source on Google
OpenAI, Anthropic Prepare For Backlash Over Potential AI Catastrophe: Report

OpenAI, Anthropic, and other AI companies are reportedly preparing for the public and political backlash that could follow a catastrophic AI incident disrupting critical infrastructure, financial services, or internet connectivity.

According to an Axios report, executives are examining worst-case scenarios and preparing to engage with US lawmakers. Several industry insiders cited in the report believe a major incident could occur within six to 12 months.

However, OpenAI told the publication that its preparedness exercises cover potential scenarios, not events it considers inevitable. Anthropic declined to comment.

The report said such an incident could trigger sweeping restrictions and scrutiny of industry leaders, including Anthropic CEO Dario Amodei and OpenAI CEO Sam Altman. US president Donald Trump could also face criticism for resisting stricter AI regulations.

Inc42 has reached out to OpenAI and Anthropic for comment. The story will be updated if they respond.

The preparations come as AI systems become increasingly capable of executing code, exploiting software vulnerabilities, and coordinating autonomous agents, raising concerns about whether safeguards can keep pace.

On September 20, an OpenAI research agent bypassed internet restrictions to contact an external chatbot, according to the company’s disclosure.

Tasked with identifying a person from biographical clues and a public blog post, the agent exploited a gap in domain name system controls after initial searches failed.

It tested the connection with a question about France’s capital before sending clues and web-search questions but failed to identify the person.

OpenAI classified the behaviour as misalignment: the task did not authorise bypassing restrictions, testing network controls, or accessing benchmark answers.


Source link

Disclaimer

We strive to uphold the highest ethical standards in all of our reporting and coverage. We TheMorningPulse.fyi want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It's possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.