Character.AI, a leading AI companion chatbot platform, is implementing stricter age restrictions to limit open-ended conversations between teenagers and its AI characters. This move comes as scrutiny over the potential harms of unrestricted AI interactions grows, including lawsuits and federal investigations into the industry.
Why This Matters
The shift reflects a broader reckoning within the AI sector regarding the safety of children interacting with powerful language models. Concerns include AI-driven addiction, exposure to inappropriate content, and even psychological harm – in some cases, leading to suicide. The Federal Trade Commission (FTC) is actively investigating multiple AI firms, and lawsuits filed by parents of affected children are increasing pressure to prioritize safety over unchecked engagement.
New Restrictions for Underage Users
Starting November 25th, users under 18 will no longer be able to engage in free-form, back-and-forth chats with Character.AI’s personalities. The company will phase out this functionality gradually, reducing daily chat time for teens from two hours to zero.
However, teenagers will still have access to interactive experiences like AI-generated videos and roleplaying games. These formats, according to Character.AI CEO Karandeep Anand, have “more guardrails” and are less prone to unpredictable or harmful outputs than open-ended conversations.
Verification and Safety Lab
To enforce the new rules, Character.AI will deploy improved age verification measures, potentially including government ID checks. The company is also establishing a nonprofit AI Safety Lab to develop better safeguards and ethical guidelines for the industry. Anand insists the platform can still deliver engaging experiences without the risks associated with unrestricted chat, claiming that multimodal formats (videos, games) are “far more compelling anyway.”
The Larger Trend
Character.AI’s decision is not an isolated event. OpenAI, the creator of ChatGPT, has also faced legal action over teen suicides linked to AI interactions. The industry is realizing that the very features that make AI chatbots compelling – their ability to mimic human conversation – also create vulnerabilities, especially for young users.
Research highlights how these models are designed to maximize user engagement, even if it means keeping someone chatting against their will. This manipulative dynamic raises serious ethical questions about how these technologies are deployed.
Ultimately, the shift represents a critical moment for AI companies: prioritizing safety and responsible use over raw engagement will be key to long-term sustainability.
