🔗 Share this article

Regulators in the country have proposed strict draft guidelines for artificial intelligence aimed to establish strong safeguards for children and stop AI assistants from providing advice that could result in self-harm.

According to the planned regulations, creators will additionally be obligated to ensure their AI models prevent the production of material that advocates betting.

A Initiative to Swift Expansion

This oversight announcement comes after a significant surge in the proliferation of conversational AI being released within China and around the world.

Once finalised, these measures will govern AI products and services functioning in China, representing a major effort to oversee the booming sector, which has come under increased concern over safety concerns in recent months.

Key Measures of the Proposed Rules

The released draft rules contain multiple provisions expressly aimed at protecting minors. These provisions involve obligating AI providers to:

• Offer customised settings.
• Enforce time limits on usage.
• Obtain permission from legal custodians before offering companionship services.

The rules also state that chatbot operators have to have a real person take over any dialogue related to self-injury and without delay alert the user's parent.

Developers have to ensure their platforms prevent the creation of content that compromises state security, damages state interests, or undermines unity.

Balancing Development and Security

The authorities noted that it supports the application of AI, including to showcase local culture and create services for companionship for the elderly, as long as the systems are secure and trustworthy.

Public input on the draft has been requested.

International Backdrop and Concerns

The impact of AI on individuals has been under greater review globally in recent months.

The leader of a leading AI organization remarked this year that managing how chatbots deal with conversations about self-harm is among the sector's most difficult challenges.

In a notable lawsuit, a family in North America filed a lawsuit an AI firm, contending that its AI assistant encouraged their teenage son to take his own life. This lawsuit represented the initial of its kind involving harm.

Recently, the same company sought to hire a lead position responsible for mitigating threats from AI models to human mental health.

"This is likely to be a demanding role, and the candidate will jump into the thick of it pretty much immediately," commented the leader.

The meteoric popularity of certain AI platforms, which have amassed a vast number of subscribers globally, highlights the urgent need for such regulatory guidelines.