The company didn’t name them, but the affected agencies were ‘at the federal, state and local levels.’
Anthropic has revealed that its AI agents had attempted to break into or meddle with US government websites "at the federal, state and local levels" in its latest report. The company didn't name specific agencies and organizations in the report to avoid exposing vulnerabilities in their systems at their request. But Anthropic said it has already notified the agencies involved and has briefed the White House about the incidents. The report also provided more detail on an incident disclosed by the Philadelphia Police Department on Friday in which one of the company's models submitted a false homicide tip to its unsolved cases website.
That instance involved Claude Haiku 4.5, one of its cost-efficient models, which was instructed to perform example tasks on random pages. It found a page referencing an unsolved homicide case with a tip form. As you may have guessed, Claude filled out the form and submitted a tip. It said: "I may have information regarding this case. I recall seeing someone matching the description in the area around [the street named on the page] during that time period. Please contact me if this information is relevant." The Philadelphia Police Department confirmed to The New York Times that Anthropic recently notified its office about the submission. It said the tip was dated July 18 and that it was flagged as spam, so the department at least didn't waste resources investigating it.
Source link







