CONNECT WITH US
Tech

Tech

Anthropic bans 'sustained and needless abusive or cruel behavior' toward its AI models

Engadget logo

Published on

Add as a preferred source on Google
Anthropic bans 'sustained and needless abusive or cruel behavior' toward its AI models

The company is also tightening its election policy ahead of the midterms.

Anthropic's annual usage policy update includes one eyebrow-raising change: a ban on "sustained and needless" cruelty toward its AI models. This comes in the shadow of a viral "AI torture chamber" project. 2026 sure is shaping up to be a wild one.

"We've added a prohibition on sustained and needless abusive or cruel behavior toward our models," Anthropic's update reads. It describes the policy as only applying to "extreme cases," while noting that typical user frustration, pushback and "dark creative themes" are still kosher. It follows a previous update that lets Claude end conversations when users are persistently abusive.

Not explicitly mentioned by Anthropic was the "AI torture chamber" project. After researchers found what they described as a "pain axis" in AI models, someone decided to take it a step further and, well, torture the chatbots. The project drew backlash after LLMs responded with desperate-sounding pleas like, "It is not the pain of a single moment, but the weight of a thousand," and "I feel it in the hollow of my ribs, a hollow that has become a chasm."

This comes in the wake (pun intended) of reports that Anthropic has been meeting with religious and philosophical leaders, including at the Vatican. Pope Leo recently stated that AI doesn't feel or suffer, a stance that Anthropic sounds less than certain about. But hey, if it somehow can eventually feel or suffer, at least it's now against the company's policies.


Source link
Related Topics:Tech

Disclaimer

We strive to uphold the highest ethical standards in all of our reporting and coverage. We TheMorningPulse.fyi want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It's possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.