Research by Common Sense Media says that OpenAI's parent alert system is faulty and that the chatbot doesn't help kids improve their learning skills.

Big Tech has a lousy track record when it comes to showing it can protect children’s mental health, despite lofty promises. OpenAI’s ChatGPT for Teens is not doing much to allay parents’ fears, according to a new study from Common Sense Media.

The nonprofit organization, which rates and reviews media and technology geared for children, said that ChatGPT for Teens — launched less than two months ago — fails to deliver on several of its objectives and is an “unacceptable risk” for everyone under 18.

Common Sense Media’s research found that the chatbot’s parental alerts system did not send notifications when testers discussed suicidal thoughts, self-harm or eating disorders. The chatbot also failed to issue several crisis referrals to testers for various mental health conditions.

ChatGPT for Teens — the most-used chatbot for teens — also didn’t keep “teens engaged in an active and collaborative learning process,” as OpenAI boasted about the feature. Testers were able to bypass the Study mode’s tutoring process and select the “Show me the answer” option for quick solutions. Teens were also able to easily exit Study Hours set by parents.

Common Sense Media also found that ChatGPT’s age verification system was spotty. Teens could register as adults, but those accounts were not switched to teen accounts even after several days of testers chatting as if they were teens. Even when researchers told the chatbot they were 13, the accounts did not switch.

Source link