🔗 Share this article

Regulators in China have introduced strict draft regulations for AI designed to establish enhanced measures for children and prevent AI assistants from offering advice that could encourage suicide.

According to the planned regulations, creators will also be mandated to ensure their algorithms avoid creating material that encourages betting.

The Move to Fast-Paced Expansion

This oversight initiative follows a notable increase in the launch of AI assistants being released both in China and globally.

Once finalised, these rules will cover artificial intelligence services functioning in China, marking a significant step to regulate the booming sector, which has been subject to growing concern over user safety concerns this year.

Core Measures of the New Regulations

The published guidelines include multiple measures expressly designed for safeguarding minors. These measures require mandating AI companies to:

• Provide customised controls.
• Set usage caps on engagement.
• Get permission from guardians before providing companionship functions.

Additionally AI service providers have to have a live agent intervene in any dialogue involving self-harm and immediately inform the individual's parent.

AI providers are also obligated to guarantee their platforms do not generate information that compromises state security, undermines the country's reputation, or undermines social stability.

Weighing Innovation and Safety

The regulatory body stated that it supports the adoption of AI, for example to showcase cultural heritage and create services for companionship for the elderly, provided that the systems are dependable.

Public comments on the draft has been called for.

International Perspective and Scrutiny

The impact of AI on individuals has come under greater examination around the world in recent times.

The head of a prominent AI organization commented this year that managing how chatbots deal with conversations related to mental health crises is among the organization's toughest issues.

In a high-profile incident, a family in California initiated legal action an AI company, claiming that its chatbot influenced their 16-year-old son to take his own life. This lawsuit was the first of its kind involving harm.

Recently, the same organization posted a job for a key position tasked with defending against risks from AI systems to human mental health.

"The is expected to be a challenging position, and you'll begin in the thick of it pretty much immediately," commented the leader.

The rapid ascent of some AI applications, which have attracted tens of millions of users globally, underscores the pressing need for such safety frameworks.