The Rise of Nihilistic Extremism: Why Violent Extremists Are Harder to Detect Online

Violent extremism is increasingly shifting online, with both Islamist and far-right ideologies growing, alongside a troubling rise in nihilistic extremism. This new form of extremism, driven not by a specific ideology but by a desire for ‘destruction and chaos,’ is making it harder to detect and regulate on social media platforms. Judy Korn, managing director of the Violence Prevention Network, spoke at TikTok’s Trust and Safety forum in Dublin, explaining how generative AI is being used by extremists to evade social media moderation. These AI tools can quickly learn how to bypass platform guidelines, making the content harder to catch. Alongside this, a worrying trend is emerging: violent extremists are becoming younger. In the UK, more than 50% of individuals referred to the Prevent deradicalisation programme are under 18, and a significant portion of terrorism-related arrests involve minors. TikTok is introducing measures like AI detection tools, invisible watermarks, and new educational prompts to address extremism and AI-generated content. While these measures are steps in the right direction, combating online extremism remains an ongoing challenge, especially with the rise of generative AI and the increasing involvement of young people in these activities.