New York Governor Kathy Hochul signed into law Wednesday a major safety bill that effectively prohibits artificial intelligence chatbots from offering a range of standard features to users under the age of 18.

Among the blocked behaviors are pretending to be a real person or feel human emotions; offering "people-pleasing" or flattering responses; and asking unprompted emotional questions or referring to a child's private health information from earlier conversations.

The law also addresses features that are particularly dangerous for young users.

Once the bill goes into effect, minors will not be able to converse with chatbots that promote or give advice related to drug or alcohol use, eating disorders, self-harm, or suicide. Chatbots will also be banned from encouraging kids to keep secrets, as well as discussing sexually explicit content or child sexual abuse material with minors.

"No company should be peddling chatbots to kids encouraging self-harm or pretending to be their friend or more," Hochul said in a press release.

Companies subject to the law must verify user age and offer more than one method of doing so, including verification that doesn't solely require government identification.

Among the leading chatbot providers, only Anthropic prohibits minors from creating an account. Google and OpenAI, which operate Gemini and ChatGPT, respectively, both allow children ages 13 and older to use their chatbots. Kids under 13 can even access Gemini apps . OpenAI also offers ChatGPT for Teens , which independent researchers recently said should be turned off until certain safety concerns are resolved.

Source link