Risk of Self-radicalisation among Vulnerable Individuals Arising from Use of Large Language Model Platforms
Ministry of Home AffairsSpeakers
Summary
This question concerns the assessment and mitigation of self-radicalisation risks from large language models as raised by Mr Cai Yinzhou. Coordinating Minister for National Security and Minister for Home Affairs K Shanmugam explained that AI can accelerate radicalisation through interactive, validating responses, citing recent cases of youths using chatbots for terrorism-related activities. The Government utilizes the amended Broadcasting Act and the Online Criminal Harms Act to remove extremist content, supported by Internal Security Department outreach to schools. Additionally, the Ministry of Education integrates cyber wellness into its curriculum to equip students with skills to recognise digital risks and stay safe online. Community partners like the Religious Rehabilitation Group further enhance these efforts through digital outreach aimed at strengthening public awareness and early reporting.
Transcript
22 Mr Cai Yinzhou asked the Coordinating Minister for National Security and Minister for Home Affairs (a) whether the Ministry has assessed the risk of self-radicalisation among vulnerable individuals arising from the use of large language models that may produce validating or reinforcing outputs; and (b) what measures are the Internal Security Department and relevant agencies taking or considering to detect and mitigate such risks.
Mr K Shanmugam: Self-radicalisation is often driven by progressive exposure to online radical content, reinforcement within online echo chambers and repeated and sustained consumption of extreme and violent materials. Artificial intelligence (AI)-enabled tools like large language models (LLMs) can accelerate and amplify the pathways to self-radicalisation. For example, they can provide personalised and interactive responses which affirm or validate an individual's radical beliefs. Social media algorithms can also drive exposure to reinforcing content, hastening the time taken for self-radicalisation.
Youths are particularly vulnerable due to the significant amount of time they spend online. Some of the self-radicalised Singaporean youths that the Internal Security Department (ISD) has dealt with, have leveraged AI, including LLMs, to facilitate terrorism-related activities. For instance, a 17-year-old detained in September 2024 used an AI chatbot to generate a pledge of allegiance to the Islamic State in Iraq and Syria and his attack manifesto. A 17-year-old far-right extremist detained in March 2025 had searched on an AI chatbot for instructions on producing ammunition and on 3D-printing of firearms, for his local attack plans.
The Government takes a holistic approach to tackling online radicalisation. We have strengthened our legislative levers through the amended Broadcasting Act and the new Online Criminal Harms Act to block or remove extremist and terrorist content, including those generated by AI. However, it is impossible to detect and remove all such content.
Public education and community vigilance are critical complements to tackling the radicalisation threat. ISD works with the Ministry of Education (MOE) to conduct counter-terrorism and counter-radicalisation outreach to schools. These engagements sensitise students and school personnel to the threat of radicalisation, and the importance of early reporting of suspected radicalisation cases. MOE's cyber wellness lessons in the character and citizenship education curriculum aim to equip students with the skills to recognise risks in the digital space and to be safe, respectful and responsible online users. In addition, community partners, such as the Religious Rehabilitation Group, have intensified counter-radicalisation outreach in the digital space. The Ministry of Home Affairs also works with digital content creators to raise awareness on the threat of online radicalisation.