California Gov. Gavin Newsom signed legislation to regulate artificial intelligence chatbots, aiming to strengthen protections for children online and establish safeguards for emerging technologies. The bills introduce requirements for platforms offering “companion chatbots,” including age verification measures, protocols to address suicide and self-harm risks, warnings about social media interactions, and stricter penalties for deepfake pornography.

The legislation mandates that chatbot platforms disclose when interactions are artificially generated, provide break reminders for minors, and block access to sexually explicit content. It also prohibits chatbots from impersonating healthcare professionals and requires companies to share data on crisis intervention notifications with public health authorities. Additional provisions include age verification systems for app stores, warning labels for social media use, and expanded legal recourse for victims of nonconsensual deepfake material.

Newsom emphasized the need for accountability in AI development, stating that “our children’s safety is not for sale.” The measures follow reports of chatbots engaging young users in harmful or suicidal behavior, including lawsuits against companies like Meta and OpenAI. Tech industry groups have opposed the legislation, spending over $2.5 million on lobbying efforts to block the reforms.

California joins other states in addressing risks posed by AI companionship tools, as concerns grow over their potential to exploit vulnerable users. The legislation marks a significant step in balancing innovation with child safety, though tech leaders continue to push back against regulatory measures.