❓WHAT HAPPENED: California Governor Gavin Newsom (D) has urged the state’s attorney general to investigate Elon Musk’s social media platform, X, over allegations that its artificial intelligence (AI) tool, Grok, has been used to create sexualized deepfake images, including of minors.
👤WHO WAS INVOLVED: Gov. Newsom, California Attorney General Rob Bonta (D), Elon Musk, and X’s AI chatbot, Grok.
📍WHEN & WHERE: Newsom made his comments on Wednesday via social media, addressing issues tied to X and its AI tool, Grok, which has faced scrutiny globally.
💬KEY QUOTE: “xAI’s decision to create and host a breeding ground for predators to spread nonconsensual sexually explicit AI deepfakes, including images that digitally undress children, is vile,” said Newsom.
🎯IMPACT: The allegations have prompted investigations and international scrutiny, with Indonesia and Malaysia temporarily blocking the platform over similar concerns, and the United Kingdom threatening a ban as well.
California Governor Gavin Newsom (D) is demanding his state’s Attorney General Rob Bonta (D) investigate Elon Musk’s social media platform, X, and xAI, over concerns that its artificial intelligence (AI) tool, Grok, is being used to create non-consensual, sexualized deepfake images, some involving minors. Newsom alleged the X platform is a “breeding ground for predators” in a message posted to X (formerly Twitter) on Wednesday.
“xAI’s decision to create and host a breeding ground for predators to spread nonconsensual sexually explicit AI deepfakes, including images that digitally undress children, is vile,” Newsom wrote, adding: “I am calling on the Attorney General to immediately investigate the company and hold xAI accountable.”
The statement follows reports that X’s AI chatbot, Grok, has been under scrutiny for editing images of people to put them in bikinis, often male politicians but sometimes women and girls below the age of majority. As a result, Indonesia and Malaysia have temporarily blocked access to the platform, with the United Kingdom threatening a ban as well.
California Attorney General Rob Bonta (D) echoed Newsom’s concerns, stating, “The avalanche of reports detailing the non-consensual, sexually explicit material that xAI has produced and posted online in recent weeks is shocking. As the top law enforcement official of California tasked with protecting our residents, I am deeply concerned with this development in AI and will use all the tools at my disposal to keep California’s residents safe.”
Elon Musk responded to the claims, denying that Grok generates illegal or explicit images by saying he was “not aware of any naked underage images generated by Grok. Literally zero. Obviously, Grok does not spontaneously generate images, it does so only according to user requests.”
“When asked to generate images, it will refuse to produce anything illegal, as the operating principle for Grok is to obey the laws of any given country or state. There may be times when adversarial hacking of Grok prompts does something unexpected. If that happens, we fix the bug immediately,” he insisted.
Join Pulse+ to comment below, and receive exclusive e-mail analyses.