AI has amplified one of the most harmful types of abusive content online.

AI has amplified one of the most harmful types of abusive content online.

      Gemini Nano Banana

      Although advancements in AI have led to many beneficial tools, they have also exacerbated some of the most troubling areas of the internet.

      A new report from the Internet Watch Foundation (IWF) has revealed a significant rise in AI-generated child sexual abuse material (CSAM) online in 2025. It emphasizes the large-scale misuse of generative AI, marking not a minor increase, but clear evidence of the production and distribution of such content.

      Why this news is concerning

      The IWF reported that more than 8,000 AI-generated images and videos of abusive content were detected in 2025, reflecting a 14% increase from the previous year. More alarmingly, there has been a dramatic rise in the number of video instances. The report noted a staggering 260-fold increase in AI-generated videos, with many classified in the highest severity category of abuse.

      In fact, approximately 65% of the videos examined were categorized as the most extreme type of abuse, highlighting the severity of the issue.

      How AI is decreasing the barriers to harmful content

      The most significant shift isn’t just in quantity, but in accessibility.

      Experts indicate that generative AI tools are greatly simplifying the creation of realistic abusive material. Some systems can produce lifelike images and videos, alter existing photos, and generate content at scale with minimal effort. This capability enables malicious actors to create and distribute harmful material more quickly and affordably than before.

      Gemini Nano Banana

      Previously, such dangerous content was often linked to the dark web. However, the report emphasizes that much AI-generated material is now available on the open web, rather than confined to the internet's hidden sections. This change complicates detection efforts, makes moderation more challenging, and heightens the risk of exposure.

      Why there are no straightforward solutions

      The emergence of AI-generated content presents a new layer of challenges for law enforcement and platforms. Since the material can be completely synthetic or based on real images, tracking its origin or identifying victims becomes increasingly difficult. Additionally, removing this kind of content poses further challenges. With the rapid advancements in AI tools, protective measures often lag behind.

      Tech journalist and product reviewer specializing in consumer electronics. Sean has covered everything from flagship…

      Sony won't revive the Vita, but Anbernic did

      Anbernic's latest handheld resembles a PS Vita revival

      While Sony seems to have moved on from the PlayStation Vita, its legacy remains influential. Anbernic has introduced the new RG Vita and RG Vite Pro, two handheld gaming consoles designed with inspiration from the PS Vita. From their spacious layout to button arrangement and overall look, these devices pay tribute to Sony's last genuine portable console.

      Razer's new Blade 16 is Intel-powered with improved battery life and performance

      The 2026 refresh emphasizes efficiency, AI, and raw power.

      Razer has officially introduced the 2026 Blade 16, with the most significant change being its internal components rather than its design. After using AMD last year, Razer is now returning to Intel, equipping the new Blade 16 with the Intel Core Ultra 9 386H processor.

      Your wallet may not be ready for ASUS' new prices

      ASUS signals significant price increases for PCs as component costs rise

      ASUS is set to raise the prices of its PCs substantially, with recent reports indicating that the increases could be steeper than initially anticipated. This decision comes in response to mounting pressures in the global hardware market, fueled by rising component costs and ongoing supply issues. Price hikes could reach as much as 30%.

AI has amplified one of the most harmful types of abusive content online. AI has amplified one of the most harmful types of abusive content online. AI has amplified one of the most harmful types of abusive content online. AI has amplified one of the most harmful types of abusive content online. AI has amplified one of the most harmful types of abusive content online. AI has amplified one of the most harmful types of abusive content online.

Other articles

It's not only the amount of time spent on the screen, but also the frequency with which you reach for your phone that's detrimental to your mind. It's not only the amount of time spent on the screen, but also the frequency with which you reach for your phone that's detrimental to your mind. According to researchers, it's not the duration of phone use that causes mental overload, but rather the frequency of checking it. The first trailer for the Harry Potter TV series has been released, and it gives off a sense of a sequel that I didn't request. The first trailer for the Harry Potter TV series has been released, and it gives off a sense of a sequel that I didn't request. HBO’s reboot of Harry Potter was intended to reinterpret the books, but the initial trailer appears to closely mirror the films, prompting a straightforward question: If nothing is different, what is the purpose of this? Giraffe360 secures $10 million in Series B funding to enhance its AI property media platform. Giraffe360 secures $10 million in Series B funding to enhance its AI property media platform. Giraffe360, the property technology company that merges a robotic camera with AI to create a complete property media kit from a single visit, has secured $10 million in Series B funding. Samsung's latest Exynos 1680 is set to enhance AI and graphics capabilities for mid-range smartphones. Samsung's latest Exynos 1680 is set to enhance AI and graphics capabilities for mid-range smartphones. The Exynos 1680 is Samsung's newest mid-range chipset, offering improved graphics and quicker on-device AI performance in comparison to the previous Exynos 1580. It has arrived! NASA announces the complete livestream timetable for the crewed lunar mission. It has arrived! NASA announces the complete livestream timetable for the crewed lunar mission. The anticipation is growing as NASA approaches the launch of four astronauts on a mission around the moon in just a few days. On Wednesday, the agency released its schedule for the final preparations and the main event, which includes a Q&A session with the astronauts this Friday, the launch taking place on Wednesday, April 1, and ongoing updates […] Arkadia Space secures €14.5M for eco-friendly propulsion technology. Arkadia Space secures €14.5M for eco-friendly propulsion technology. Arkadia Space has obtained €14.5 million from the EIC Accelerator to bring its hydrogen peroxide propulsion system to market.

AI has amplified one of the most harmful types of abusive content online.

In 2025, there was a notable increase in AI-generated abusive content, prompting watchdog organizations to caution that this technology is facilitating the creation and distribution of harmful material.