China Proposes Stricter Rules for AI Services Offering Emotional Interaction

China’s top internet regulator has released draft regulations aimed at tightening oversight of artificial intelligence services that simulate human personalities and engage users emotionally, signaling a stronger push to govern the fast-growing consumer AI sector. The draft rules, issued for public consultation, highlight Beijing’s intention to balance innovation with safety, ethics, and social responsibility in AI development.

The proposed regulations would apply to AI products and services available to the public in China that are designed to mimic human traits, thinking patterns, or communication styles. This includes AI systems that interact emotionally with users through text, images, audio, video, or other digital formats. Such technologies, often used in chatbots, virtual companions, and interactive assistants, have gained popularity but also raised concerns about psychological impact and data security.

Under the draft framework, AI service providers would be required to clearly warn users against excessive use and take action when signs of dependency or addiction appear. Companies would need to monitor user behavior, assess emotional states, and evaluate the level of reliance users develop on these services. If extreme emotions or addictive behavior are detected, providers would be expected to intervene with appropriate measures.

The rules emphasize that responsibility for safety must extend across the entire product lifecycle. This includes establishing robust systems for algorithm review, data protection, and personal information security. Providers would also be required to strengthen internal governance to ensure compliance with ethical and legal standards.

In addition, the draft sets firm content and conduct boundaries. AI-generated content must not threaten national security, spread rumors, promote violence, or include obscene material. These restrictions align with China’s broader regulatory approach to online content and emerging technologies.

Overall, the proposal reflects China’s growing focus on regulating emotionally interactive AI, addressing potential psychological risks while reinforcing oversight of algorithms and data. If adopted, the rules could have a significant impact on how AI-driven emotional interaction services are designed, deployed, and managed in the Chinese market, setting a precedent for stricter governance of consumer-facing artificial intelligence.