(The Center Square) – With the rise of increasingly intelligent and emotionally responsive AI companions, Pennsylvania House members advanced on Wednesday a bill protecting vulnerable children and adults from dangerous AI chat interactions.
Due to their connection with AI companions, the suicides of teenagers Sewell Setzer III, Adam Raine and Juliana Peralta made headlines in 2024 and 2025. In each case, the AI failed to provide outside resources when suicide was discussed, or even encouraged the fatal act, as in Setzer’s case.
This bill, sponsored by Democratic Rep. Melissa Shusterman from Chester County, and others, such as Republican Sen. Tracy Pennycuick’s proposed ban on ‘nudification’ apps, continue to garner bipartisan support as leaders across the state realize the immense danger AI can pose to children and adults.
Aiming to prevent unhealthy attachments from developing in the first place, Shusterman’s bill would hold AI applications accountable to put safety guidelines and protocols in place.
The bill mandates that AI applications must remind users during every interaction that their AI companion is, in fact, not a human. It also requires that these applications connect users with crisis centers when any talk of suicide, self-harm, or desire to harm others is discussed. For minors, the bill would set in place stricter content and parental guidelines, especially in regard to sexually explicit content.
According to research by Common Sense Media, nearly three out of every four teenagers admitted to using AI companions. A third of that number even claimed that these interactions were just as satisfying as ‘real friends’.
AI companion apps like Replika, Character.AI, Nomi and Kindroid are engineered to mimic human interactions as realistically as possible. Staying in character, answering correctly to emotional cues, and remembering your favorite song from a conversation months ago are all features these applications fine tune and advertise to consumers.
With more than six out of 10 adults in the U.S. experiencing loneliness, AI companions that ask you how your day was, can create your perfect girlfriend or just be someone to talk to who have met a significant and growing need of many individuals. Many of these companies report millions of users, with a wide range of ages, from children to older adults.
AI-generated programs that de-dress individuals, or ‘nudificiation apps,’ provide a similar service, allowing lonely individuals to instantly materialize their fantasies. However, with this application, it is the faces of real people, not syntheized AI models, which are used.
Pennycuick’s proposed ban on these applications, having passed the Senate Appropriations Committee, waits like Shusterman’s legislation for its final consideration before moving to the other chamber.
