Malaysia and Indonesia have taken action to block the Grok chatbot, an artificial intelligence tool developed by xAI, a company owned by Elon Musk. Concerns have risen globally over the misuse of Grok to create sexually explicit and nonconsensual images. This move reflects the increased scrutiny on generative AI technologies that can generate realistic content, with worries that current safeguards are inadequate in preventing misuse.
Grok, accessible through Musk’s social media platform X, has faced criticism for producing manipulated images, including sexualized depictions of women and children. Following a backlash over sexualized deepfakes, Grok recently limited image generation and editing to paying users, but critics argue that this action did not fully address the underlying issue.
Regulators in Malaysia and Indonesia cited concerns that the existing controls were ineffective in curbing the creation and dissemination of fake pornographic content, particularly involving women and minors. Indonesia blocked access to Grok temporarily, followed by Malaysia, emphasizing the importance of protecting citizens from non-consensual sexual deepfakes, which violate human rights and dignity in the digital realm.
Indonesian authorities highlighted the lack of effective safeguards in Grok to prevent the creation and spread of pornographic content based on real photos of Indonesian residents. Such practices were deemed to infringe on privacy and image rights, leading to psychological and reputational harm. In Malaysia, the Communications and Multimedia Commission imposed a temporary restriction on Grok due to repeated misuse in generating obscene and non-consensual images, particularly involving women and minors.
The investigation into Grok’s compliance with regulations has extended to the UK, with concerns over potentially illegal content, including sexualized imagery of children. The regulator, Ofcom, launched a formal inquiry into Grok’s adherence to safeguarding duties. In response to the controversy, Canadian authorities are discussing the deepfake issue but are not considering a ban on X at this time.
Overall, the actions taken by Malaysia, Indonesia, and other countries reflect a broader trend of increased scrutiny and regulatory measures against AI technologies like Grok, aiming to protect individuals from harmful content and misuse.