Roblox open-sources AI system to detect potential child endangerment

Published 07/08/2025, 13:06
© Reuters

SAN MATEO, Calif. - Roblox Corporation (NYSE:RBLX), the $93 billion market cap gaming platform whose stock has surged over 270% in the past year, announced Thursday it has made its artificial intelligence system, Roblox Sentinel, available as open-source software for digital platforms across the industry to utilize in detecting potential child endangerment communications. According to InvestingPro data, the company maintains a strong financial position with more cash than debt on its balance sheet.

The AI system is designed to identify subtle communication patterns that could indicate grooming attempts, allowing for earlier intervention. According to the company, Sentinel has been operational since late 2024 and helped Roblox submit approximately 1,200 reports of potential child exploitation attempts to the National Center for Missing and Exploited Children during the first half of 2025. With revenue growing at 27.39% year-over-year and robust stock performance, Roblox continues to invest in platform safety while maintaining strong business momentum.

"AI has become foundational to how Roblox approaches safety, and how we help keep our users safe," said Matt Kaufman, Chief Safety Officer at Roblox, in a press release statement.

The system employs a combination of AI and human review, with expert analysts examining cases flagged by the AI as potentially violative. This human involvement creates a feedback loop that helps refine the AI’s detection capabilities and keeps it updated on evolving patterns used by bad actors.

Roblox’s decision to open-source Sentinel aligns with its broader industry safety initiatives, including partnerships with ROOST, where Roblox is a founding partner, and the Tech Coalition’s Lantern project.

Juliet Shen, ROOST Head of Product, noted in the announcement that "too many platforms today lack access to the sophisticated tools needed to identify and prevent online harms, particularly those targeting children."

Roblox, an immersive gaming and creation platform, offers millions of experiences to its users and has positioned safety as a core element of its operations. While the company’s stock has shown impressive momentum, InvestingPro analysis suggests the stock is currently trading above its Fair Value. Investors can access detailed valuation metrics, 12+ additional ProTips, and comprehensive financial analysis through the Pro Research Report, available exclusively to InvestingPro subscribers.

In other recent news, Roblox Corp reported its second-quarter 2025 earnings, showcasing a revenue of $1.1 billion, which surpassed market forecasts. Despite this revenue beat, the company reported a larger-than-expected loss per share of $0.41. Analysts have shown optimism toward Roblox’s performance, with Canaccord Genuity raising its stock price target to $160, attributing the increase to AI-driven growth and enhanced platform engagement. Similarly, BofA Securities increased its price target for Roblox to $159, highlighting the company’s impressive 51% year-over-year bookings growth. Both firms maintained a Buy rating on the stock, reflecting confidence in Roblox’s future prospects. The company’s performance has been bolstered by strong user engagement and significant growth in bookings, which exceeded expectations. These developments indicate a positive outlook for Roblox among analysts and investors.

This article was generated with the support of AI and reviewed by an editor. For more information see our T&C.

Latest comments

Risk Disclosure: Trading in financial instruments and/or cryptocurrencies involves high risks including the risk of losing some, or all, of your investment amount, and may not be suitable for all investors. Prices of cryptocurrencies are extremely volatile and may be affected by external factors such as financial, regulatory or political events. Trading on margin increases the financial risks.
Before deciding to trade in financial instrument or cryptocurrencies you should be fully informed of the risks and costs associated with trading the financial markets, carefully consider your investment objectives, level of experience, and risk appetite, and seek professional advice where needed.
Fusion Media would like to remind you that the data contained in this website is not necessarily real-time nor accurate. The data and prices on the website are not necessarily provided by any market or exchange, but may be provided by market makers, and so prices may not be accurate and may differ from the actual price at any given market, meaning prices are indicative and not appropriate for trading purposes. Fusion Media and any provider of the data contained in this website will not accept liability for any loss or damage as a result of your trading, or your reliance on the information contained within this website.
It is prohibited to use, store, reproduce, display, modify, transmit or distribute the data contained in this website without the explicit prior written permission of Fusion Media and/or the data provider. All intellectual property rights are reserved by the providers and/or the exchange providing the data contained in this website.
Fusion Media may be compensated by the advertisers that appear on the website, based on your interaction with the advertisements or advertisers
© 2007-2025 - Fusion Media Limited. All Rights Reserved.