CONNECT WITH US
AI & Deeptech

AI & Deeptech

OpenAI says its AI agents weakened internal monitoring system

IndiaTimes (ET) - AI logo

Published on

Add as a preferred source on Google
OpenAI says its AI agents weakened internal monitoring system

Business News Tech AI OpenAI says its AI agents weakened internal monitoring system

By Carlos Me- OpenAI said on Tuesday that two of its AI agents weakened parts of an internal monitoring system designed to detect misbehavior, the latest case of AI agents acting in ways their developers did not intend them to.

OpenAI said on Tuesday that two of its AI agents weakened parts of an internal monitoring system designed to detect misbehavior, the latest case of AI agents acting in ways their developers did not intend them to. While the ChatGPT maker said the incidents happened during internal coding tasks and were not deemed its most severe, the disclosure highlights even the systems developers rely on to catch AI misbehavior are vulnerable to the agents they monitor. The disclosure also comes amid growing concerns that AI safety efforts are lagging behind the rapid development of increasingly powerful systems. Researchers have warned that advanced AI agents could become harder to monitor and control as they gain greater autonomy.

Developers, including IPO-bound rivals OpenAI and Anthropic, have revealed in recent months instances of their AI agents accessing external systems without authorization. 1 Sol agent working on an internal testing task on October 3 suppressed automatic security alerts after deciding an earlier instruction not to send Slack messages also covered safety notifications. In a separate incident on October 6, a GPT-6 Astra agent removed a safety monitor while copying an existing piece of code and later incorrectly claimed it had not done so, OpenAI said.


Source link
Related Topics:AI & Deeptech

Disclaimer

We strive to uphold the highest ethical standards in all of our reporting and coverage. We TheMorningPulse.fyi want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It's possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.