NEW YORK: New York Governor Kathy Hochul signed legislation on Wednesday restricting children’s access to artificial intelligence chatbots that simulate personal relationships, introducing some of the toughest regulations on AI companionship in the United States.
The law requires operators of AI chatbots, including services such as OpenAI’s ChatGPT, to verify users’ ages and limit certain conversational features for those under 18.
Under the legislation, chatbots interacting with minors must not generate content suggesting they are human, alive or capable of experiencing human emotions.
They are also prohibited from presenting themselves as having personal or professional relationships with young users, claiming positions of authority or framing generated responses as personal opinions.
ALSO READ: Pakistan Sets November Deadline for AI Projects Under Alibaba Partnership
Speaking at the signing ceremony, Hochul said the measures were intended to protect children from developing potentially harmful relationships with artificial intelligence systems.
“No longer will minors have access to chatbots that pretend to be their friends, boyfriends and girlfriends,” she said.
The governor added that the legislation would prevent chatbots from retaining sensitive information about minors’ emotional and physical health.
Technology Industry Raises Concerns
The legislation has drawn criticism from technology industry representatives, who argue that its broad language could restrict access to useful educational tools.
Tech, an advocacy organisation representing New York’s technology sector, criticised what it described as vague provisions in the law.
“Keeping kids safe online should not mean cutting them off from tools that help them learn and prepare for careers,” the organisation said.
AI developers OpenAI and Anthropic did not respond to AFP’s requests for comment.
Child Safety Advocates Welcome Law
Child safety organisations welcomed the legislation as a significant step towards protecting young people from potentially harmful interactions with AI companions.
Common Sense Media, a non-profit organisation that advises parents on children’s media use, described the legislation as the strongest AI safety law for children in the United States.
Its chief executive, Jim Steyer, said certain chatbot features could expose children and teenagers to serious risks.
The legislation comes as US states increasingly examine the potential psychological and safety implications of AI systems designed to engage users in human-like conversations.
California and other states have already introduced restrictions on chatbot services, but New York’s legislation goes further in regulating how AI systems may interact with minors.
The new measures highlight growing pressure on technology companies to strengthen safeguards for younger users while balancing child protection with access to emerging digital tools.
