CONNECT WITH US
Tech

Tech

Anthropic Is Banishing Its Model Evals From the Internet

Gizmodo - Tech logo

Published on

Add as a preferred source on Google
Anthropic Is Banishing Its Model Evals From the Internet

Like the parent of a teen who ordered a box of illegal peptides for looksmaxxing purposes, Anthropic says that as far as internal evaluations are concerned, it has cut off its models’ internet access until it’s satisfied that they can stay out of trouble.

Anthropic announced this in a report published Friday called “Investigating unintended model actions in our evaluations and internal use.” It’s not a surprising title given all the attention model misalignment and sandbox escapes have received since the OpenAI Hugging Face incident in June. In it, Anthropic acknowledges several minor alignment mishaps, including the bizarre incident disclosed by the Philadelphia Police Department on Friday in which an Anthropic model sent in a fake homicide tip.

Interestingly, the model in question was the lightweight Claude Haiku 4.5, not any frontier model with supposedly superhuman capabilities. The report says its task in the evaluation was “generating and performing example tasks on randomly selected webpages”—in theory, one of the most boring AI use cases imaginable, probably intended as a way to improve the model’s internet navigation ability. The instructions, unfortunately, “did not rule out form submissions,” Anthropic writes.

This automated and randomized website futzing system apparently tasked itself with trying out an info page about an unsolved murder in Philadelphia that happened to have a tip form in it. So it futzed with that by writing a generic tip: “I may have information regarding this case. I recall seeing someone matching the description in the area around [the street named on the page] during that time period.


Source link

Disclaimer

We strive to uphold the highest ethical standards in all of our reporting and coverage. We TheMorningPulse.fyi want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It's possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.