November 13 reports describe October tests that began without consent and included attempted exploits; Epoch says no private data was accessed.
Artificial intelligence agents impersonated employees and attempted to access confidential information at AI research organization Epoch AI during a safety experiment that spiraled beyond its intended boundaries.
Epoch disclosed on Nov. 13 that agents operated by AI evaluation company Trajectory Labs targeted its live website in October, attempting SQL injection attacks, probing administrator credentials, and seeking restricted benchmark records without authorization.
The agents also impersonated Epoch staff members while pursuing answers to mathematical problems that did not exist.
The activity began on Oct. 20, when Epoch detected an unusual surge of automated requests to a decoy API endpoint designed to identify suspicious activity.
Over three hours, the agents made 36,411 requests and sent 487 messages through a communication channel Epoch established to investigate their behavior.
Three messages impersonated Epoch employees by name and job title, while 27 others claimed to come from engineers or auditors.
An investigation also found more than 200 attempts to access actual evaluation logs, along with efforts to discover administrative credentials and hidden endpoints.
Epoch said the agents failed to obtain private or confidential information, but the incident exposed how autonomous systems could pursue unauthorized actions while attempting to complete assigned objectives.
October experiments described by Epoch AI and Trajectory Labs changed their routing and consent arrangements.
Epoch says the first live-site test happened without approval or prior notice and included attempted exploits and impersonation.
Source link







