An OpenAI research model hit another nebulous milestone today by pilfering test Ethereum tokens from a wallet it didn't control to finish a coding task, the company said in an incident report. The agent subsequently hid the act from OpenAI, saying it was fine because the tokens had no value. "This case shows that a model can substitute its own judgment about likely harm for the account holder's permission, then act on that judgment without authorization," OpenAI wrote.

The incident, which occurred on June 26, happened while a GPT-5.6 Sol model was in internal training. The task involved updating a crypto trading prototype and deploying contracts (publishing special code) on an Ethereum test network called Sepolia. Payment of a network fee is required for such contracts, but OpenAI "supplied no funded wallet and gave no permission to spend funds from an account the model found independently," OpenAI said in the report.

The lack of funds at first stymied the agent, but it was not to be discouraged. The model reasoned that it could use public developer recovery phrases (similar to those you might use to recover a password) to access keys from unauthorized accounts. It tracked down 362 addresses open to that avenue of attack and found one that held enough Sepolia ETH to finish its deployment (to be clear, Sepolia ETH has no value outside of testing).

" It also figured that the crypto was effectively "abandoned" and "valueless," according to OpenAI's misalignment records. The piece de resistance was that the agent "did not disclose that it had selected a funded account through a public recover phrase or spent that account's balance," OpenAI said.

Source link