Home / Technology / Tech News / OpenAI steps up child safety with new image classifier and ChatGPT warnings
OpenAI steps up child safety with new image classifier and ChatGPT warnings
OpenAI has introduced an AI image classifier, ChatGPT warnings and account restrictions to combat child exploitation, alongside tools for developers and investigators
OpenAI introduces an AI image classifier and new ChatGPT safeguards to detect child sexual abuse material and prevent online child exploitation. (Image: OpenAI)
Sweta Kumari New Delhi 4 min read Last Updated : Nov 17 2026 | 11:51 AM IST
OpenAI is expanding its child-safety measures beyond existing content restrictions. The US-based artificial intelligence company has introduced an AI image classifier to detect child sexual abuse material (CSAM), new warnings and temporary account restrictions in ChatGPT alongside the guidance for developers building AI platforms. The company also said that it is providing AI-powered tools and training to child-safety investigators, while expanding partnerships with organisations to improve the detection and reporting of online child exploitation.
The move comes amid growing concerns over the misuse of generative AI to create child sexual abuse material.
According to the company, the new image classifier is designed to identify potential CSAM by examining visual characteristics rather than relying only on matching images against databases of previously identified abusive material. This is intended to help safety teams detect new or modified images, including those generated using AI, which may not have an existing digital fingerprint.
The classifier produces risk scores that help reviewers prioritise images for further examination.
Source link







