Indonesia becomes first nation to block xAI’s Grok over deepfake risks

The decision marks the first country-level restriction on Elon Musk-owned Grok, as regulators cite risks of non-consensual sexual deepfakes and inadequate safeguards, intensifying global scrutiny of generative AI platforms and their content controls.

Indonesia has become the first country to block access to xAI’s Grok chatbot, citing serious concerns over the tool’s ability to generate explicit and exploitative imagery. The move reflects growing unease among governments worldwide about the misuse of generative artificial intelligence and its implications for digital safety and human rights.

The restriction was imposed after Indonesia’s Ministry of Communication and Digital Affairs assessed that Grok lacked sufficient controls to prevent the creation of pornographic material, including non-consensual sexual deepfakes. Officials said such content poses a direct threat to personal dignity, online security, and public trust in digital platforms.

Government cites human rights and safety risks

Communications and Digital Minister Meutya Hafid said the government views non-consensual sexual deepfakes as a grave violation of human rights and citizen safety in the digital space. She confirmed that the ministry has reached out to representatives of X to discuss the findings and the steps required to address regulatory concerns.

Indonesia enforces strict online content rules, with laws that prohibit the distribution of obscene or sexually explicit material. Authorities said the temporary block on Grok aligns with these regulations while investigations and discussions with the platform continue.

The action follows reports that Grok’s image-generation features had been misused to create sexualised images, including altered images of women placed in explicit scenarios. Concerns were heightened by international reports suggesting the technology could also be misapplied to generate illegal content involving minors.

Global pressure mounts on xAI and X

The Indonesian decision comes amid rising regulatory scrutiny across Europe and the Asia-Pacific region. In response, xAI has announced restrictions on Grok’s image creation and editing tools, limiting full access to paying subscribers while strengthening safety filters.

Elon Musk has stated that users who generate illegal content using Grok would face consequences similar to those applied for directly uploading such material. However, regulators in multiple countries have continued to question whether platform-level safeguards are adequate.

Australia has also raised alarms over the misuse of generative AI for exploitative purposes. Prime Minister Anthony Albanese recently criticised platforms that fail to prevent non-consensual sexual content, calling such practices unacceptable. Australia’s eSafety regulator has warned it will use its enforcement powers, including takedown notices, where content violates the country’s Online Safety Act.

As governments tighten oversight, Indonesia’s move could set a precedent for how nations respond to AI tools that fail to meet evolving standards for digital responsibility and user protection.