CONNECT WITH US
Tech

Tech

OpenAI steps up child safety with new image classifier and ChatGPT warnings

Business Standard - Technology logo

Published on

Add as a preferred source on Google
OpenAI steps up child safety with new image classifier and ChatGPT warnings

Home / Technology / Tech News / OpenAI steps up child safety with new image classifier and ChatGPT warnings

OpenAI steps up child safety with new image classifier and ChatGPT warnings

OpenAI has introduced an AI image classifier, ChatGPT warnings and account restrictions to combat child exploitation, alongside tools for developers and investigators

OpenAI introduces an AI image classifier and new ChatGPT safeguards to detect child sexual abuse material and prevent online child exploitation. (Image: OpenAI)

Sweta Kumari New Delhi 4 min read Last Updated : Nov 17 2026 | 11:51 AM IST

OpenAI is expanding its child-safety measures beyond existing content restrictions. The US-based artificial intelligence company has introduced an AI image classifier to detect child sexual abuse material (CSAM), new warnings and temporary account restrictions in ChatGPT alongside the guidance for developers building AI platforms. The company also said that it is providing AI-powered tools and training to child-safety investigators, while expanding partnerships with organisations to improve the detection and reporting of online child exploitation.

The move comes amid growing concerns over the misuse of generative AI to create child sexual abuse material.

According to the company, the new image classifier is designed to identify potential CSAM by examining visual characteristics rather than relying only on matching images against databases of previously identified abusive material. This is intended to help safety teams detect new or modified images, including those generated using AI, which may not have an existing digital fingerprint.

The classifier produces risk scores that help reviewers prioritise images for further examination.


Source link

Disclaimer

We strive to uphold the highest ethical standards in all of our reporting and coverage. We TheMorningPulse.fyi want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It's possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.