CONNECT WITH US
Gaming

Gaming

Roblox makes three of its AI safety tools open source

GamesIndustry.biz logo

Published on

Add as a preferred source on Google
Roblox makes three of its AI safety tools open source

Platform has shared its tools on the Robust Open Online Safety Tools Model Community (ROOST), which it co-founded in 2025 with Google, OpenAI, and Discord

Roblox is open-sourcing three of its AI safety models via the Robust Open Online Safety Tools Model Community (ROOST).

ROOST is an independent nonprofit that develops and maintains open-source infrastructure for online safety. Roblox co-founded ROOST in 2025 with Google, OpenAI, and Discord.

Roblox is contributing its PII Classifier, Roblox Sentinel, and its latest voice safety classifier to ROOST. These models are already deployed on Roblox's platform.

The PII Classifier identifies attempts to share or request personally identifiable information (PII), including misspellings, coded language, and disguised references to other platforms.

Roblox is also sharing an evaluation dataset from this tool, which features "synthetic samples of English-language multiuser chats modelled on techniques often used to evade PII filters."

Roblox Sentinel detects early signs of potential child endangerment. The latest voice safety classifier moderates voice chat in real time and incorporates feedback from the ROOST community.

Roblox is also releasing a new evaluation dataset to help companies assess the effectiveness of their safety tools. The latest version supports moderation in 30 languages and eight violation categories.

"Sharing these models gives other platforms a robust starting point to train and tune their own moderation tools," said vice president of trust and safety engineering Naren Koneru. "In turn, we hope to benefit from the learnings and feedback of other companies as they share their work."

"Safety is a shared responsibility – no company can solve it alone.


Source link
Related Topics:Gaming

Disclaimer

We strive to uphold the highest ethical standards in all of our reporting and coverage. We TheMorningPulse.fyi want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It's possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.