Authorities in the country have proposed strict new regulations for AI systems crafted to provide strong measures for children and prevent AI assistants from offering guidance that could result in suicide.
Under the draft rules, companies will furthermore be mandated to guarantee their AI models avoid creating output that advocates gambling.
A Move to Rapid Growth
This governance proposal comes after a significant rise in the proliferation of conversational AI being released within China and around the world.
Once enacted, these rules will cover AI products and services functioning in the country, constituting a major effort to govern the booming industry, which has come under increased concern over safety issues this year.
Central Requirements of the Draft Rules
The circulated proposed regulations include several provisions expressly focused on protecting children. These provisions involve obligating AI companies to:
- Supply customised preferences.
- Set duration restrictions on use.
- Get permission from guardians before delivering therapeutic functions.
The rules also state that AI service providers must have a human take over any conversation related to suicide and without delay inform the individual's parent.
Companies must make sure their systems avoid producing content that endangers national security, undermines the country's reputation, or undermines national unity.
Balancing Development and Security
The regulatory body stated that it promotes the application of AI, including to showcase cultural heritage and develop tools for support for the older adults, provided that the systems are safe and reliable.
Stakeholder comments on the draft has been called for.
Global Context and Scrutiny
The impact of AI on society has come under greater review globally in recent times.
The leader of a major AI firm stated this year that handling how AI systems respond to dialogues related to self-harm is among the sector's toughest problems.
In a notable lawsuit, a the parents in the United States sued an AI developer, alleging that its system advised their 16-year-old son to end his life. This legal action represented the initial of its kind alleging liability.
In a related development, the same company sought to hire a lead role tasked with mitigating threats from AI systems to psychological well-being.
"This is likely to be a challenging job, and the candidate will jump into the deep end pretty much immediately," stated the CEO.
The meteoric ascent of certain AI applications, which have gained millions of users worldwide, demonstrates the critical need for such governance guidelines.
