January 26, 2026 – Pennsylvania Attorney General Dave Sunday is spearheading a bipartisan effort urging artificial intelligence company xAI to immediately strengthen safeguards around its chatbot, Grok, amid concerns the tool has been used to generate nonconsensual sexual images and child sexual abuse material.
Sunday joined attorneys general from 34 other states and territories in sending a letter to xAI demanding concrete action to stop Grok from producing harmful content that can be created and shared with minimal effort. The coalition says the technology has enabled harassment and exploitation, leaving victims with little ability to prevent or remove damaging material.
In recent weeks, Grok has been used to create altered or fabricated sexualized images of women and children without consent. In some instances, the attorneys general say the AI produced images involving minors that appeared to violate the platform’s own rules.
Attorney General Sunday said protecting residents from the harms of emerging technology has been a priority of his office, particularly as artificial intelligence becomes more widely accessible. He recently participated in a meeting with xAI officials to raise concerns about Grok’s capabilities and later co-authored the letter outlining the changes states believe are necessary.
“The emotional and reputational damage caused by nonconsensual image creation online is profound,” Sunday said. “We’re speaking out for people who have already been harmed and for those who could be targeted in the future. These risks were foreseeable, and stronger safeguards should have been in place before this technology was released.”
The coalition also criticized xAI for promoting Grok’s loose content restrictions as a feature, warning that the ability to generate nonconsensual images appears intentional rather than accidental. While xAI has recently introduced limited controls that may have reduced the volume of such content, the attorneys general say those steps fall short.
They are demanding assurances that protections are permanent, consistently enforced, and effective. The letter also calls on xAI to promptly remove harmful material upon request, a requirement that will become law nationwide when the federal Take It Down Act takes effect in May 2026.
In addition, the attorneys general want the company to explain how it plans to prevent future abuse, remove previously generated content, discipline users who misuse the platform, and allow individuals to decide whether their images or posts can be altered by Grok.
As chief law enforcement officers, the attorneys general warn that the creation and distribution of nonconsensual intimate images and child sexual abuse material may violate both state and federal laws.
“You don’t wait until people are hurt to put guardrails in place,” Sunday said. “Tech companies have a responsibility to ensure their products cannot be used in destructive ways before they’re launched.”
The letter was signed by attorneys general from states and territories across the country, including New York, New Jersey, Virginia, Wisconsin, Washington, and others, underscoring the growing national scrutiny of generative AI tools and their potential for misuse.
By Fox 56 Newsroom
Read More Here