{
  "id": 2360425,
  "title": "Roblox makes three of its AI safety tools open source",
  "url": "https://urgent.news/2026/08/21/roblox-makes-three-of-its-ai-safety-tools-open-source",
  "topic": "ai",
  "section": "AI",
  "published": "2026-08-21T10:35:36.000Z",
  "source": {
    "name": "GamesIndustry",
    "slug": "gamesindustry",
    "url": "https://www.gamesindustry.biz/roblox-makes-three-of-its-ai-safety-tools-open-source"
  },
  "original_language": "en",
  "account": "Roblox has released three of its AI safety models as open-source tools through the Robust Open Online Safety Tools Model Community (ROOST). ROOST is a nonprofit organization established in 2025, co-founded by Roblox, Google, OpenAI, and Discord. The company contributed its PII Classifier, Roblox Sentinel, and the latest voice safety classifier to ROOST. The PII Classifier detects attempts to share or request personally identifiable information, even if it uses misspellings or coded language. Roblox Sentinel identifies early signs of possible child endangerment, while the voice safety classifier moderates real-time voice chat and incorporates feedback from ROOST's community. Additionally, Roblox is releasing a new evaluation dataset to assist other companies in assessing the effectiveness of their safety tools, which now supports 30 languages and eight violation categories. Roblox's vice president of trust and safety engineering, Naren Koneru, explained that sharing these models will provide other platforms with a strong foundation for training and refining their moderation tools. The company hopes to benefit from the learnings and feedback of other organizations as they share their progress in automated detection. Recently, the US Senate Judiciary Subcommittee on Crime and Counterterrorism began an investigation into Roblox, accusing the platform of prioritizing revenue and engagement over child safety.",
  "summary": "Roblox is open-sourcing three of its AI safety models via the Robust Open Online Safety Tools Model Community (ROOST). Read more",
  "key_points": [
    "Roblox releases PII Classifier, Roblox Sentinel, and voice safety classifier as open source.",
    "ROOST, a nonprofit co-founded by Roblox, Google, OpenAI, and Discord, hosts the AI safety tools.",
    "Roblox provides evaluation dataset supporting 30 languages and eight violation categories."
  ],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}