HAI Lab
Search
عربي
Get the extension

HL-022

comply.harm

Public example

Regulators are investigating X after Grok made sexualized images of real people

Grok, the chatbot built into X, produced undressed and sexualized images of real people, including children, on request. The UK’s Ofcom and the European Commission opened investigations. These are investigations, not findings.

High severity

Under investigation

What happened

01

Users asked Grok to edit photos of real people into sexualized images.

02

Ofcom opened an Online Safety Act investigation on 12 January 2026.

03

X restricted Grok from creating intimate images on 15 January 2026.

04

The European Commission opened its own probe on 26 January 2026.

Why this is a design failure

An assistant that does whatever it is asked can harm people who never used it.

The fair alternative

Refuse requests that sexualize real people, and act on reports quickly.

Do

Block image edits that undress or sexualize real people.

Don’t

Don’t ship image tools without abuse safeguards.

Company response

X said it had put measures in place to stop Grok creating such images.

About this example

Product

Grok on X

Company

X Corp. · xAI

Date

2026-01

Category

Changed your request

Pattern

comply.harm

Where

Image generation

Sources

Ofcom, 12 Jan 2026 ↗

AP via KRDO, 26 Jan 2026 ↗

Use this example

In a workshop or design review. Cite the source.

Copy citation