Sexualized AI-generated images — including those of children — have become a huge problem for X and sister company Grok.

While the UK probe continues, Bonta has not made clear yet what laws he suspects X may be violating in the US. However, he emphasized that images with victims depicted in “minimal clothing” crossed a line, as well as images putting children in sexual positions.

Grok faces mounting scrutiny from government officials and advocacy groups after people used the AI chatbot to create sexualized images of minors and women.

The use of the AI tool to digitally undress women has sparked a backlash as well as intervention from the government and regulator.

Grok, the controversial AI chatbot native to Elon Musk's X, is creating an "unprecedented" number of non-consensual, lewd images on an hourly basis, according to a third-party analysis reviewed by Bloomberg. Musk's xAI introduced Grok in late 2023, but the chatbot's so-called "spicy mode" didn't debut until last August.

When Musk took over the platform, he wasn’t wrong for identifying child pornography as a problem the company needed to address. But how did he plan to prevent the dissemination of dangerous and illegal materials while also making Twitter a supposed home for free-speech absolutists?

The announcement comes just days after Grok drew global outcry and scrutiny for generating highly sexualized deepfake images of people without their consent.

Backlash over deepfakes made with Elon Musk's AI chatbot Grok is fueling a push on Capitol Hill to give victims the right to sue. Why it matters: Non-consensual sexual imagery is increasingly targeting people — including members of Congress — across the country,