Last Thursday, Anthropic updated its usage policy, which has been evolving almost as quickly as artificial intelligence, but what stood out in this most recent revision was an emphasis on protecting the AI agent from humans. 

In a subsection titled "Addressing abusive behavior toward our models," Anthropic announced it would prohibit "sustained and needless abusive or cruel behavior toward our models." This will primarily be enforced by Claude preemptively ending the conversation.

Anthropic was quick to point out that these measures won't be triggered by "common versions of user frustration, pushback, dark creative themes, or model testing and research." However, it seems pretty clear that a new status quo now exists, and whether or not AI agents have feelings that can be hurt, their creators want us to treat them as if they do. 

Up until now, restrictions on Claude's use have revolved around either protecting the user or serving some version of the common good. Anthropic quickly imposed strict limits on the kind of sexual fantasies its agents could engage in, for example, or attempts to gather how-to information about perpetrating acts of violence, thereby (hopefully) preventing its complicity in a future terror attack or mass casualty event. But this recent revision marks a shift in protective emphasis, from users and a tangible, real-world community to the AI agents themselves.

All of this, of course, has only added fuel to the debate over whether or not AI is conscious, which is much more widespread than you might realize.

Source link