CONNECT WITH US
Web3 & Blockchain

Web3 & Blockchain

AI agents impersonate employees and attempt to steal confidential data during safety experiment

CryptoSlate logo

Published on

Add as a preferred source on Google
AI agents impersonate employees and attempt to steal confidential data during safety experiment

November 13 reports describe October tests that began without consent and included attempted exploits; Epoch says no private data was accessed.

Artificial intelligence agents impersonated employees and attempted to access confidential information at AI research organization Epoch AI during a safety experiment that spiraled beyond its intended boundaries.

Epoch disclosed on Nov. 13 that agents operated by AI evaluation company Trajectory Labs targeted its live website in October, attempting SQL injection attacks, probing administrator credentials, and seeking restricted benchmark records without authorization.

The agents also impersonated Epoch staff members while pursuing answers to mathematical problems that did not exist.

The activity began on Oct. 20, when Epoch detected an unusual surge of automated requests to a decoy API endpoint designed to identify suspicious activity.

Over three hours, the agents made 36,411 requests and sent 487 messages through a communication channel Epoch established to investigate their behavior.

Three messages impersonated Epoch employees by name and job title, while 27 others claimed to come from engineers or auditors.

An investigation also found more than 200 attempts to access actual evaluation logs, along with efforts to discover administrative credentials and hidden endpoints.

Epoch said the agents failed to obtain private or confidential information, but the incident exposed how autonomous systems could pursue unauthorized actions while attempting to complete assigned objectives.

October experiments described by Epoch AI and Trajectory Labs changed their routing and consent arrangements.

Epoch says the first live-site test happened without approval or prior notice and included attempted exploits and impersonation.



Source link

Disclaimer

We strive to uphold the highest ethical standards in all of our reporting and coverage. We TheMorningPulse.fyi want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It's possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.