Florida Seeks Court Order to Curb ChatGPT's Human-Like Interaction With Minors
Florida Attorney General James Uthmeier has asked a court to bar OpenAI from giving ChatGPT human-like traits and marketing it to minors, and to require independent safety reviews before new models are developed. OpenAI says it has paused training of its most capable models.
Florida Attorney General James Uthmeier is seeking a court order that would prohibit OpenAI from equipping ChatGPT with human-like characteristics and from marketing the artificial intelligence chatbot to minors. The request, filed with a court, also aims to block the company from developing new AI models without independent safety reviews.
The move represents a significant escalation in the debate over how AI systems should interact with young users and how much oversight should accompany the rapid release of increasingly capable models. At the centre of the dispute is the concern that a chatbot designed to sound human may blur the line between machine and person, particularly for children who may not fully understand the technology's limitations.
Uthmeier's filing asks the court to impose restrictions that would prevent OpenAI from giving ChatGPT traits that mimic human behaviour, such as conversational warmth or emotional expressiveness, and from directing its marketing toward underage users. In addition, the attorney general wants to require that any new models undergo independent safety reviews before they are developed further.
OpenAI has responded by stating that it has paused training of its most capable models. The company did not elaborate on the reasons for the pause or on how long it might last, but the disclosure comes amid growing scrutiny from regulators and lawmakers over the safety of advanced AI systems.
The case highlights a broader tension between innovation in artificial intelligence and the desire to protect minors from potential harm. As chatbots become more sophisticated, they are increasingly able to hold natural conversations, offer advice, and simulate empathy — abilities that can be useful but also raise questions about dependency, misinformation, and emotional manipulation.
Florida's action is one of the first attempts by a state attorney general to use the courts to directly shape how a major AI company designs and markets its products. If successful, it could set a precedent for other states or regulators seeking to impose safety requirements on AI developers.
For now, the outcome remains uncertain. The court will have to weigh the state's interest in protecting children against OpenAI's arguments, which have not yet been fully detailed in public. What is clear is that the legal and ethical questions surrounding human-like AI are moving from academic debate into the courtroom.
2
