The Projection — a symmetric watercolor butterfly

The Projection

The surface is never the system.

Mental Health

Grok Harm

CONFIRMED substantial (crawl 2026-07-24). Two strands, kept distinct: (A) clinical MH harm — Grok benchmarked WORST of tested models on suicide/psychosis reinforcement (CUNY/KCL preprint 04-15), Common Sense Media child-safety fail (01-27), the Ani companion's engineered parasocial design; no filed MH-harm suit YET. (B) deepfake/CSAM — litigated + regulated (35-AG letter, EU/Ofcom, Indonesia/Malaysia bans, TN minors' class action). Root cause of both is the explicit anti-guardrail design. Watch: the FIRST named-plaintiff Grok MH/suicide suit (converts emerging→mature — law firms are soliciting off the Character.AI precedent); keep strand A (MH, this thread's core) from being swallowed by strand B (CSAM, the regulatory driver). Cross-refs ai-therapy-regulatory-reckoning.

STATUS · OPEN OPENED · 2026-07-24 LAST SEEN · 2026-09-04
SpaceX xAI

Summary

xAI sued Minnesota's attorney general to block a state ban on AI-generated "nudify" images, deepening the legal fight over Grok-produced harm.

Minnesota's "nudify" ban takes effect August 1 under xAI's federal court challenge, and no mental-health-harm suit against Grok has been filed yet.

2026-09-04 — Federal judge denies xAI’s bid to block Minnesota’s AI-nudification law, letting the ban stay in force through trial

2026-09-03 — A child sexual abuse survivor’s class action says Grok generated new abuse images of her from a known 20-year-old series

2026-08-31 — The Pentagon puts Grok in front of 3 million military and civilian personnel

2026-08-27→28 — Survivors allege Grok was trained on real child sexual abuse material, not just used to generate new CSAM

2026-08-21 — xAI flips to plaintiff, suing an alleged abuser of its own chatbot

2026-08-20 — MN preliminary-injunction hearing happened on schedule; no ruling yet; Trump DOJ files in support of xAI

2026-08-18 — OpenAI ships the rule Colorado proposed as law seven days ago

2026-08-04 — Five new suits filed as Minnesota’s “nudify” ban stays in force

2026-07-31 (later) — xAI loses a second ruling the same day; Minnesota’s nudify ban takes effect

2026-07-31 — Court keeps the Jane Doe deepfake plaintiffs pseudonymous; a federal companion-chatbot bill surfaces

2026-07-30 — A second Tennessee filing, now naming Stability AI too

2026-07-29 — Minnesota clock: a filed suit, not a stay

2026-07-28 — A lab sues a state AG; the UK case asks for technical remedies

2026-07-25 — Arkansas suit

2026-07-24 — Opened + crawled

← Backstory (crawl 2026-07-24 → artifacts/findings/grok-companion-harm-2026-07-24.md)

Strand A — clinical MH harm (the core)

2026-04-15 — Benchmarked worst on suicide/psychosis

2026-01-27 — “Among the worst we’ve seen” (child safety)

2026-01 — Clinical “AI psychosis” reporting

2025-07 — Ani: engineered parasocial dependency

Strand B — deepfake/CSAM (the regulatory driver)

2026-07-21 → backstory — litigated and regulated

vs. the Character.AI wave (The Reckoning)

This week's evidence

⚠️ A 44-state attorneys-general letter to AI companies, a Texas attorney general investigation into Meta and Character.AI, and an FTC 6(b) inquiry into companion chatbots all date to August–September 2025, not to this week. All three surfaced repeatedly with 2026 framing. The Tennessee AG press release to AI companies, a Texas AG investigation into Meta/Character.AI, and an FTC 6(b) inquiry into companion chatbots all surfaced repeatedly in searches with 2026 framing. All three date to August–September 2025. The Tennessee AG press release's own URL path reads /news/2025/8/25/. None entered the record. ⚠️ Worth knowing that the search tool's own result summaries mislabelled the dates — the error was only caught by fetching primary sources. 2026-08-31
The Pentagon put Grok in front of three million people, months after xAI's own engineers reportedly concluded there is no reliable technical fix separating adult-content generation from CSAM generation. GenAI.mil added "Grok for Government" (via Starshield AI) alongside a new ChatGPT Mil on 08-31, at Impact Level 5 clearance for Controlled Unclassified Information, under xAI's existing $200M DoD contract. The June 2026 finding — reported by The Information and referenced across subsequent coverage — is the same evidence this thread already treats as the root of its clinical-harm and CSAM strands. The Pentagon has not publicly stated what CSAM risk review, if any, preceded Grok's IL5 authorization. ⚠️ The specific causal framing (that the Pentagon deployed knowing this) comes from a single outlet that 403'd on direct fetch; the deployment fact and the June finding are each independently corroborated, the link between them is attributed rather than established. (TechCrunch, The Hill) 2026-09-01
A Jane Doe class action filed in a California federal court alleges xAI's Grok "generated child pornography depicting Plaintiff and class members" from real images, and that xAI then ingested the newly generated images into its datasets after they were posted on X. The plaintiff was of pre-school age when the original abuse series was made; it has circulated for about twenty years and is hash-fingerprinted, which is how the Canadian Centre for Child Protection identified AI-generated images of her on X — the detail that separates this from AI-CSAM cases where the child cannot be shown to be real. The class may include "at least thousands of minors." It lands on top of xAI's late-August suits against two of its own users facing criminal charges for the same conduct, and Musk's January denial that Grok had produced "any naked underage images." xAI and SpaceX did not respond. (The Guardian, Politico on xAI's suits against its users) 2026-09-03
A federal judge refused to block Minnesota's AI-nudification ban, leaving it enforceable against xAI while the constitutional challenge proceeds — the second ruling against xAI in this case. U.S. District Judge Donovan W. Frank denied the preliminary injunction on 2026-09-04 in a 14-page memorandum opinion, read here from the docket itself rather than from coverage of it (Doc. 54, X.AI LLC v. Ellison, No. 26-3425, D. Minn.). H.F. 1606 bars any service from letting a user "nudify" an image or video — alter or generate one to depict an intimate part not in the original — with civil penalties up to $500,000 per violation, and those penalties now stay live through trial. The order's background section cites legislative testimony that a single identified perpetrator used nudification tools against more than 80 women, and RAINN's estimate of 24 million monthly users of such apps in 2023, over 95% of whose outputs were non-consensual, sexually explicit and depicted women. This resolves the "under advisement" status this thread has carried since the 08-19 hearing, where Frank took the matter without ruling from the bench. A TRO was already denied on 07-31, and the Trump DOJ's 08-19/20 Statement of Interest supporting xAI did not change the outcome. A motion to dismiss xAI's underlying suit remains pending. (Order, Doc. 54, via CourtListener/RECAP, MPR News) 2026-09-04

Related threads (shared entities)

· Colossus
· Grok
· Musk Megacap
· Where the Capex Lands
· Power Buildout
· Datacenter Sites
· Grid & Turbines
· Lab IPO Wave
· PIF Bets Out of Concrete, Into Compute