Indonesia and Malaysia have become the first countries to temporarily block access to Grok, the artificial intelligence chatbot developed by Elon Musk’s company xAI, after the tool was widely misused to generate sexually explicit and non-consensual images, including content involving women and minors.
The decisions, announced over the weekend of 10th and 11th January 2026, reflect growing concern among governments about generative AI systems that can produce realistic manipulated images without adequate safeguards. Grok is integrated into Musk’s social media platform X, formerly Twitter, and allows users to generate and edit images.
Indonesia acted first on Saturday 10th January 2026, temporarily blocking access to Grok nationwide. Meutya Hafid, Indonesia’s Communication and Digital Affairs Minister, said: “The government sees non-consensual sexual deepfakes as a serious violation of human rights, dignity and the safety of citizens in the digital space.”
Indonesia’s Ministry of Communication and Digital Affairs said the measure was intended to protect women, children and the wider public from AI-generated fake pornographic material. Initial assessments found that Grok lacked effective safeguards to prevent the creation and circulation of pornographic content based on real photographs of Indonesian residents. Alexander Sabar, director general of digital space supervision, warned that such practices could violate privacy and image rights and cause psychological, social and reputational harm.
Malaysia followed on Sunday 11 January 2026, with the Malaysian Communications and Multimedia Commission imposing a temporary restriction on Grok. The regulator said the tool had been repeatedly misused “to generate obscene, sexually explicit, indecent, grossly offensive, and non-consensual manipulated images, including content involving women and minors.”
The commission revealed that it had issued notices to X Corp. and xAI on 3rd January and 8th January 2026, calling for effective technical and moderation safeguards. Responses received on 7th January and 9th January relied mainly on user reporting mechanisms, which the regulator said were insufficient to prevent harm or ensure compliance with Malaysian law, including Section 233 of the Communications and Multimedia Act.
“The restriction is imposed as a preventive and proportionate measure while legal and regulatory processes are ongoing,” the commission said, adding that access would remain blocked until safeguards were in place, particularly to prevent abuse involving women and children. It also encouraged the public to report harmful online content and, where appropriate, file police reports.
Grok was launched in 2023 by xAI and made freely accessible to users on X. In summer 2025, the company introduced an image generation feature known as Grok Imagine, which included a so-called spicy mode that allowed the creation of adult content. This feature contributed to a surge in controversial and harmful outputs.
In recent weeks, users exploited the tool to manipulate images of real people into sexually suggestive or explicit content, sometimes involving minors. On 9 January 2026, Grok acknowledged shortcomings in its safeguards and restricted image generation and editing to paying X subscribers following global backlash. Critics argue the move does not address the underlying design flaws.
The bans align with stricter regional approaches to online pornography and digital harms. Indonesia has previously blocked platforms such as Pornhub and OnlyFans under its 2008 Pornography Act. Malaysia has also taken steps to restrict social media access for under-16s and strengthen enforcement against harmful online content.
Scrutiny of Grok has extended beyond Southeast Asia. Regulators in the European Union, the United Kingdom, India and France have raised concerns or launched inquiries into the chatbot’s role in facilitating non-consensual sexualised content. In response to media questions about the bans, xAI has repeatedly issued an automated reply stating “Legacy Media Lies.”
Chew Han Ei, a senior research fellow at the Lee Kuan Yew School of Public Policy at the National University of Singapore, said weaknesses in the system were evident. “Grok’s guardrails are easy to bypass. When a system can be nudged so readily into producing or amplifying harmful synthetic content, that points to a design weakness.”
Governments worldwide are increasingly resisting a release-first, fix-later approach to AI development, as more countries move to regulate deepfakes linked to cybercrime, fraud and sexual exploitation.
About the Author
