CONNECT WITH US
Tech

Tech

OpenAI launches tool for finding child sexual abuse material

Mashable - Tech logo

Published on

Add as a preferred source on Google
OpenAI launches tool for finding child sexual abuse material

OpenAI announced Monday the release of a new tool to detect child sexual abuse material (CSAM), including content generated by artificial intelligence.

The tool is a classifier that looks for visual signs of abuse in images. It then scores images to help human reviewers prioritize which of them warrant attention. OpenAI said its CSAM classifier is the first broadly available tool of its kind to include a specific signal indicating the image may be generated with AI.

A new analysis conducted by Childlight — Global Child Safety Institute at the University of Edinburgh found AI-related reports of CSAM increased globally by more than 8,400 percent from 2023 to 2025. Last year, the National Center for Missing & Exploited Children received more than 400,000 of these reports. In 2023, that number was roughly 4,700.

"Individual companies like OpenAI have a responsibility to prevent our technology from being exploited by predators to harm children, and we also must work together with the broader industry, child safety organizations and law enforcement to advance our collective efforts to protect children online," OpenAI said in its blog post about the announcement.

The company's new tool can be used by organizations required or authorized to detect CSAM, including certain developers that use OpenAI's application programming interface, or API.

OpenAI also launched the tool to work with open source detection-and-reporting software called Coop. The software, which is offered by the nonprofit organization ROOST, allows users to both flag and review content and report it to the National Center for Missing & Exploited Children.


Source link

Disclaimer

We strive to uphold the highest ethical standards in all of our reporting and coverage. We TheMorningPulse.fyi want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It's possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.