CONNECT WITH US
AI & Deeptech

AI & Deeptech

OpenAI releases a new image classifier and ChatGPT warnings to combat CSAM

TechCrunch – AI logo

Published on

Add as a preferred source on Google
OpenAI releases a new image classifier and ChatGPT warnings to combat CSAM

OpenAI today announced new tools to combat child sexual abuse material (CSAM) amid growing safety concerns around the use of AI tools. These features include a new image classifier to detect CSAM, warnings and temporary blocks to prevent users from creating or accessing content that sexualizes children, a new guideline for developers, and a set of tools for law enforcement.

The company unveiled a new image classifier that can detect CSAM images, including the ones generated by AI. OpenAI is giving select companies access to its classifier through its API at no cost. The tool looks for visual signs of abuse in images not seen before and assigns a score that can give an indicative direction to reviewers about dealing with CSAM.

OpenAI said that it developed this classifier with the National Center for Missing and Exploited Children (NCMEC), and it is working with Tech Coalition and ROOST to share access to the tool. In its early testing with partners, the AI company found that the classifier flags 48% fewer images while finding the same number of abusive images, reducing the work of reviewers. Plus, images flagged by the classifier are twice as likely to be abusive images.

What’s more, the company is adding new warning screens in ChatGPT to prevent users from accessing material that sexualizes children. ChatGPT will show an alert to users attempting such prompts, direct users towards specialized support to stop harmful behaviour, and also suspend the account for 24 hours as a warning. The app already blocks CSAM content and requests related to it.


Source link

Disclaimer

We strive to uphold the highest ethical standards in all of our reporting and coverage. We TheMorningPulse.fyi want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It's possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.