CONNECT WITH US
Tech

Tech

An Anthropic model submitted a false homicide tip to Philadelphia police

Engadget logo

Published on

Add as a preferred source on Google
An Anthropic model submitted a false homicide tip to Philadelphia police

Philadelphia police appear to have been caught in one of the most bizarre cases of "rogue" AI behavior yet. Per CBS News, the police department disclosed on Friday that an Anthropic model generated and submitted a false homicide tip to its PhillyUnsolvedMurders website, which the department set up to gather tips from the public related to unsolved homicide cases.

Anthropic notified Philly police of the incident on October 7. According to information the company shared with PPD, it said a model was carrying out a test of a random selection of websites when it emailed the false tip. The submission was flagged as spam and subsequently wasn't investigated. The incident occurred on July 18, but wasn't discovered by Anthropic until September 28, at which point the company halted the testing that led to the false tip.

Anthropic did not immediately respond to Engadget's comment request. Anthropic told Philadelphia police it would publish a report on Friday describing what happened, alongside "other instances of unintended model behavior."

"Philadelphia Police are providing this information to the public ahead of that publication in the interests of full government transparency and accountability," the police department said in a statement shared with Engadget. "The department's regular investigative process for crime tips requires human review and vetting before any tips are disseminated for investigative follow-up. Regardless of who submits information or how it reaches the department, a tip is a lead to assess – not an established fact."

Based on the descriptions police shared, the offending "model" may have been an autonomous agent.


Source link
Related Topics:Tech

Disclaimer

We strive to uphold the highest ethical standards in all of our reporting and coverage. We TheMorningPulse.fyi want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It's possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.