AI has amplified one of the most harmful types of abusive content online.

AI has amplified one of the most harmful types of abusive content online.

      Gemini Nano Banana

      Although advancements in AI have led to many beneficial tools, they have also exacerbated some of the most troubling areas of the internet.

      A new report from the Internet Watch Foundation (IWF) has revealed a significant rise in AI-generated child sexual abuse material (CSAM) online in 2025. It emphasizes the large-scale misuse of generative AI, marking not a minor increase, but clear evidence of the production and distribution of such content.

      Why this news is concerning

      The IWF reported that more than 8,000 AI-generated images and videos of abusive content were detected in 2025, reflecting a 14% increase from the previous year. More alarmingly, there has been a dramatic rise in the number of video instances. The report noted a staggering 260-fold increase in AI-generated videos, with many classified in the highest severity category of abuse.

      In fact, approximately 65% of the videos examined were categorized as the most extreme type of abuse, highlighting the severity of the issue.

      How AI is decreasing the barriers to harmful content

      The most significant shift isn’t just in quantity, but in accessibility.

      Experts indicate that generative AI tools are greatly simplifying the creation of realistic abusive material. Some systems can produce lifelike images and videos, alter existing photos, and generate content at scale with minimal effort. This capability enables malicious actors to create and distribute harmful material more quickly and affordably than before.

      Gemini Nano Banana

      Previously, such dangerous content was often linked to the dark web. However, the report emphasizes that much AI-generated material is now available on the open web, rather than confined to the internet's hidden sections. This change complicates detection efforts, makes moderation more challenging, and heightens the risk of exposure.

      Why there are no straightforward solutions

      The emergence of AI-generated content presents a new layer of challenges for law enforcement and platforms. Since the material can be completely synthetic or based on real images, tracking its origin or identifying victims becomes increasingly difficult. Additionally, removing this kind of content poses further challenges. With the rapid advancements in AI tools, protective measures often lag behind.

      Tech journalist and product reviewer specializing in consumer electronics. Sean has covered everything from flagship…

      Sony won't revive the Vita, but Anbernic did

      Anbernic's latest handheld resembles a PS Vita revival

      While Sony seems to have moved on from the PlayStation Vita, its legacy remains influential. Anbernic has introduced the new RG Vita and RG Vite Pro, two handheld gaming consoles designed with inspiration from the PS Vita. From their spacious layout to button arrangement and overall look, these devices pay tribute to Sony's last genuine portable console.

      Razer's new Blade 16 is Intel-powered with improved battery life and performance

      The 2026 refresh emphasizes efficiency, AI, and raw power.

      Razer has officially introduced the 2026 Blade 16, with the most significant change being its internal components rather than its design. After using AMD last year, Razer is now returning to Intel, equipping the new Blade 16 with the Intel Core Ultra 9 386H processor.

      Your wallet may not be ready for ASUS' new prices

      ASUS signals significant price increases for PCs as component costs rise

      ASUS is set to raise the prices of its PCs substantially, with recent reports indicating that the increases could be steeper than initially anticipated. This decision comes in response to mounting pressures in the global hardware market, fueled by rising component costs and ongoing supply issues. Price hikes could reach as much as 30%.

AI has amplified one of the most harmful types of abusive content online. AI has amplified one of the most harmful types of abusive content online. AI has amplified one of the most harmful types of abusive content online. AI has amplified one of the most harmful types of abusive content online. AI has amplified one of the most harmful types of abusive content online. AI has amplified one of the most harmful types of abusive content online.

Other articles

OpenUp secures €20M to expand its employee mental health platform. OpenUp secures €20M to expand its employee mental health platform. OpenUp has secured €20 million to grow its anonymous mental health platform for employees, which provides one-on-one sessions with psychologists and specialists. It's not merely the amount of time spent on the screen, but the frequency with which you reach for your phone that is detrimental to your brain. It's not merely the amount of time spent on the screen, but the frequency with which you reach for your phone that is detrimental to your brain. Researchers indicate that it's not the duration of phone use that matters, but rather the frequency of checking it that contributes to mental overload. Sony and Honda have abandoned their electric vehicle project, AFEELA. Sony and Honda have abandoned their electric vehicle project, AFEELA. Sony Honda Mobility has called off the AFEELA 1 and its subsequent SUV following Honda's withdrawal from the electric vehicle sector, resulting in the dissolution of the joint venture. SOUS secures €4M to empower culinary entrepreneurs. SOUS secures €4M to empower culinary entrepreneurs. SOUS has secured €4 million to enhance its AI platform designed for marketing, discovery, and customer retention tailored to independent restaurants. It has arrived! NASA announces the complete livestream timetable for the crewed lunar mission. It has arrived! NASA announces the complete livestream timetable for the crewed lunar mission. The anticipation is growing as NASA approaches the launch of four astronauts on a mission around the moon in just a few days. On Wednesday, the agency released its schedule for the final preparations and the main event, which includes a Q&A session with the astronauts this Friday, the launch taking place on Wednesday, April 1, and ongoing updates […] The EU-Startups Summit is set to return to Malta in May. The EU-Startups Summit is set to return to Malta in May. The 12th EU-Startups Summit will be held in Valletta, Malta, on May 7-8, 2026, featuring more than 80 speakers, along with a media panel focused on securing press coverage for startups.

AI has amplified one of the most harmful types of abusive content online.

In 2025, there was a notable increase in AI-generated abusive content, prompting watchdog organizations to caution that this technology is facilitating the creation and distribution of harmful material.