China is currently developing regulations to mitigate risks associated with AI-generated digital humans.

      China is intensifying its efforts to regulate its rapidly expanding "digital human" industry, as emotionally engaging AI avatars—some resembling deceased loved ones—gain popularity throughout the nation. This initiative arises as both the commercial prospects and ethical implications of the technology become more apparent.

      Grief, Technology, and an Expanding Industry

      Zhang Xinyu, a 47-year-old from Liaoning province, has turned to artificial intelligence following her father's death from cancer. Partnering with a company named Super Brain, she developed a digital avatar that resembles and mimics her father, enabling her to maintain conversations online. She shared with AFP that this experience has assisted her in dealing with her grief and restoring her emotional resilience.

      AI Chatbots Unsplash

      Her experience highlights a wider movement in China, where AI-generated "digital humans" are quickly becoming popular. These avatars, which often appear and behave lifelike, are extensively utilized on social media platforms, particularly in e-commerce and content production. Per Xinhua News Agency, this sector was estimated at approximately 4.1 billion yuan ($600 million) in 2024, reflecting a year-on-year growth of 85%.

      Nonetheless, not everyone has a positive view of the technology. Some critics caution that these avatars might foster emotional dependency or provide what Zhang termed “false comfort,” even if the underlying emotions are authentic.

      Regulation Catches Up

      Addressing such concerns, the Cyberspace Administration of China has released draft regulations aimed at enhancing oversight. These proposed rules require that AI-generated content be clearly labeled and prohibit creating digital replicas without obtaining an individual's consent.

      The regulations also aim to curb misuse, including scams, misinformation, and content endangering social stability or national security. Companies that violate these rules could face fines ranging from 10,000 yuan ($1,460) to 200,000 yuan ($29,300).

      The necessity for regulation was highlighted by a viral incident where an elderly woman unknowingly interacted with a highly realistic avatar of her deceased son. This clip, which gained traction on Chinese social media, ignited discussions about whether such AI applications provide comfort or are deceptive.

      Balancing Innovation and Risk

      Experts remark that China’s approach mirrors a well-known trend of rapid technological advancements followed by swift regulatory responses. Authorities are particularly worried about safeguarding minors, with proposed rules prohibiting AI systems that promote emotional dependency or replicate intimate relationships for children.

      AI Chatbots Unsplash

      Simultaneously, industry stakeholders recognize that regulation is inevitable. The founder of Super Brain has referred to the draft regulations as a crucial move towards harmonizing innovation with responsibility.

      What Lies Ahead

      The draft regulations in China are open for public feedback until early May, after which more stringent enforcement is anticipated. The government's overarching aim is to hasten AI adoption while exercising stringent control over its societal effects.

      As “digital humans” transition from novelty to commonplace tools, China’s regulatory framework could serve as a model for other nations facing similar ethical dilemmas—especially regarding identity, consent, and the emotional influence of AI.