Safeguards to Prevent Harm to Vulnerable Users of Gen AI Chatbot App
Ministry of Digital Development and InformationSpeakers
Summary
This question concerns the safeguards required for X's Grok app to protect vulnerable users from harmful content, as raised by Ms Cassandra Lee. Minister for Digital Development and Information Mrs Josephine Teo noted that IMDA is engaging X, which has taken global steps to restrict the generation of inappropriate imagery. Existing Codes of Practice for Online Safety mandate that designated services like X implement content moderation, reporting mechanisms, and annual transparency reports to minimize user exposure to harm. Furthermore, the upcoming Online Safety (Relief and Accountability) Act and the Online Safety Commission, set for 2026, will provide redress for victims of online harassment. The Ministry will continue monitoring the situation and working with X to enhance online safety and ensure robust enforcement of regulatory measures for Singaporean users.
Transcript
21 Ms Cassandra Lee asked the Minister for Digital Development and Information (a) what safeguards the Ministry has required of X's Grok app to prevent harm to vulnerable users, including children; (b) how the adequacy and enforceability of these safeguards are assessed before and during deployment; and (c) whether interim regulatory measures will be applied to limit exposure to or scale of use of Grok app, and if so, on what basis.
Mrs Josephine Teo: IMDA is engaging X on the recent issue of harmful and inappropriate content, such as non-consensual sexualised imagery, being generated and distributed on X using Grok. We note that X has taken some measures to address the matter globally, which includes preventing the Grok account on X from producing images of women and children in revealing clothing.
There are safeguards in place to moderate Singapore users' exposure to harmful content on social media services and applications. The Codes of Practice for Online Safety require designated Social Media Services, including X, and designated app stores, to have in place measures to minimise users' exposure to harmful content, especially for children. This includes having in place community guidelines, content moderation measures and user reporting and resolution mechanisms. The designated services are also required to submit annual transparency reports detailing the measures they have put in place to combat harmful and inappropriate content.
In addition, the upcoming Online Safety (Relief and Accountability) Act will allow victims to seek redress if they face specified online harms, such as online harassment and intimate image abuse. The Online Safety Commission will be set up by June 2026.
We will continue to monitor the issue closely and will work with X to enhance online safety for Singapore users on its platform.