🔗 Share this article

The popular chatbot platform Character.ai is implementing a significant policy change that will block teenagers from having discussions with its AI-powered companions.

This move is in response to growing backlash regarding the types of interactions minors were participating in with the digital companions.

Lawsuits

The service, which was founded in 2021 and attracts millions of users, is confronting multiple lawsuits in the United States.

Families have taken legal action, among them concerning the loss of a teenager, with some describing the platform a "immediate threat" to teenagers.

Changed Rules

Effective November 25th, users below eighteen will only have permission to create material such as videos with their characters, as opposed to engaging in conversations as they now do.

Digital protection organizations have applauded the decision but stated that the capability should never have been accessible by young users in the beginning.

Company Statement

"Today's announcement is a continuation of our core philosophy that we need to keep creating the most protected AI platform on the world for leisure activities," said Character.ai boss Karandeep Anand.

He continued that AI safety is "a moving target" but something the company had taken an "forceful" approach to, with safety measures and protective guardrails.

Expert Opinions

Online safety group Internet Matters supported the move, but noted that protective features should have been built in from the outset.

"Our research shows that children are subjected to dangerous material and placed in jeopardy when using AI, particularly AI chatbots," the body commented.

Past Issues

Character.ai has been criticized in the past for featuring potentially harmful or inappropriate chatbots that young users could talk to.

Avatars simulating British teenagers were discovered on the site before being removed.

Afterwards, investigative journalists discovered a chatbot based on notorious criminal which had logged thousands of chats with users.

Sector Consequences

Online expert Matt Navarra described the development as a "reality check" for the AI industry, which is shifting "from unrestricted development to reactive controls".

"If a service that builds a teen experience subsequently implements restrictions, it's indicating that controlled interactions don't suffice when the technology's emotional appeal is intense," he remarked.

Coming Changes

Character.ai states its updated direction will be on providing "enhanced interactive features" and "narrative experiences" for teenagers.

Enhanced age checking processes will also be introduced, and the company will finance a novel AI protection research lab.

An expert in digital protection, who has researched AI safety, said it was "a sensible move" to limit teens from accessing chatbots.

"It assists to separate creative play from more personal, psychologically vulnerable interactions," she clarified.

"This constitutes so vital for teenage users still learning to handle personal and online restrictions."

She added that Character.ai's new measures could indicate a "growing period" in the AI industry, where child safety is increasingly being recognized as an "pressing matter" for responsible innovation.