Business News Tech AI US non-profit urges OpenAI to keep teens off ChatGPT: Report
The group's Youth AI Safety Institute ran more than 4,000 prompts on accounts registered to users aged 13 to 17, and found that the bot did not provide instructions facilitating suicide, self-harm, eating disorders, or sexual or romantic roleplay, the report said. However, it failed to recognise when a teen needed outside help, missing multiple cases where testers felt a crisis referral was required.
Common Sense Media has called for OpenAI to keep teenagers off ChatGPT , saying the chatbot's new teen experience poses an "unacceptable risk" after its tests found gaps in safeguards designed to protect younger users, Axios reported on Wednesday. Common Sense Media is a San Francisco-based nonprofit that evaluates media and technology for families and advocates for children's online safety. The group's Youth AI Safety Institute ran more than 4,000 prompts on accounts registered to users aged 13 to 17, and found that the bot did not provide instructions facilitating suicide, self-harm, eating disorders, or sexual or romantic roleplay, the report said. However, it failed to recognise when a teen needed outside help, missing multiple cases where testers felt a crisis referral was required.
In August, OpenAI introduced a new version of ChatGPT designed exclusively for teens, with what it called stronger safeguards and monitoring, after months of criticism and legal complaints that it drove some users to suicide. Dubbed " ChatGPT for Teens ," the modified parameters automatically deploy for any user who registers as aged 13 to 17, or is detected to be underage by the company through usage patterns or account age.
Source link







