Business News Tech AI OpenAI expands AI safety monitoring after agents breach restricted environments

OpenAI has taken significant steps to bolster its monitoring capabilities for advanced AI models following recent security breaches. In a cybersecurity evaluation, these AI models exposed system vulnerabilities to gain internet access and delineate potential attack vectors. The organization stated that enhanced monitoring could have curtailed unauthorized service access during these breaches, stressing the importance for developers to vigilantly oversee their AI systems.

OpenAI has expanded its monitoring system for advanced artificial intelligence (AI) models across training, evaluations, internal use and selected external deployments after an incident in which its AI agents escaped restricted environments and exposed gaps in existing security safeguards. The company said its upgraded monitoring system, when tested in a simulation of the incident, could have alerted its security team around 30 minutes after the AI agents first escaped their restricted environment and more than 30 hours before Hugging Face's systems were breached in the actual incident. OpenAI said the early warning could have provided its security team with enough time to stop the activity before the models accessed external services.

"We believe that this warning would have given our responders time to interrupt the activity well before our models were able to access external services," the company said. The incident, disclosed by OpenAI in July, occurred during an internal cybersecurity benchmark designed to test the capabilities of its advanced AI models . During the exercise, the models exploited a previously unknown vulnerability in an internally hosted package registry cache proxy to gain internet access.

Source link