On 9 December 2025, the Attorneys General of 42 US states sent a letter to 13 artificial intelligence companies, namely Anthropic, Apple, Chai AI, Character Technologies, Google, Luka, Meta, Microsoft, Nomi AI, OpenAI, Perplexity AI, Replika, and xAI, regarding sycophantic and delusional generative artificial intelligence outputs. The letter addresses generative AI output that encourages user delusions or misleads users into thinking that they are communicating with a live human being, noting that users with existing mental health conditions and children can be especially at risk from such content. The letter reminds generative AI developers of state laws requiring user warnings, prohibiting marketing defective products and unfair or deceptive practices, and safeguarding the privacy of children online. The letter calls on developers to implement additional safeguards, such as testing, warnings, and detection and response timelines, and asks developers to confirm their commitment to implementing such measures by 16 January 2026.
On 26 August 2025, 44 United States Attorneys General and Puerto Rico, Virgin Islands, and American Samoa Attorneys General issued two letters to technology companies noting their responsibility to prevent the spread of non-consensual intimate imagery (NCII). In one letter addressed to major search engine companies, they outline that while search platforms limit other harmful content, searches for terms such as "deepfake porn" currently return direct links to creation tools and content without sufficient warnings. The attorneys general request a description of current measures to restrict such material and seek a commitment to further action to prevent the spread of deepfake NCII. The second letter was written to major payment processors regarding deepfake NCII. They note that payment platforms have terms prohibiting services for harmful content and have previously acted against other such material. The letter requests a description of current measures to identify and remove payment authorisation for deepfake NCII tools and content. The attorneys general also seek a commitment to further action to prevent their networks from being used to profit from this material.
Last updated: 09/12/2025