Kuala Lumpur, Malaysia – January 13, 2026 – Malaysia's Communications and Multimedia Commission (MCMC) is actively considering legal proceedings against the US-based social media platform X (formerly Twitter) for failing to adequately protect users from harmful content, Communications Minister Fahmi Fadzil announced today. The potential lawsuit stems from ongoing concerns over the platform's AI chatbot Grok, developed by Elon Musk's xAI, which has been repeatedly misused to generate obscene, sexually explicit, indecent, and non-consensual manipulated images, including depictions involving women and minors.
Speaking to reporters in Shah Alam, Minister Fahmi stated that the MCMC had contacted X last week seeking clarification on Grok's capabilities to produce such content. He described the responses from X as "inadequate and pro forma," prompting his directive for a temporary restriction on Grok and the evaluation of court action. “MCMC is considering suing or taking X to court for failing to ensure the safety of users, particularly in Malaysia,” Fahmi emphasized, highlighting violations of national online safety laws, including provisions under Section 233 of the Communications and Multimedia Act 1998 that prohibit grossly offensive or indecent material.
The temporary block on Grok, effective from January 11, 2026, applies specifically to the chatbot and not the entire X platform. MCMC cited "repeated misuse" of Grok to create harmful AI-generated imagery despite prior regulatory engagement, including formal notices issued to X Corp. and xAI LLC on January 3 and January 8, 2026. These notices demanded the implementation of effective technical safeguards, content moderation, and preventive measures against unlawful outputs. Access to Grok will remain restricted until X demonstrates compliance and installs robust protections.
Malaysia and Indonesia have emerged as the first countries to impose such restrictions on Grok. Indonesia temporarily blocked the chatbot on January 10, 2026, citing the risk of AI-generated pornographic content and viewing non-consensual sexual deepfakes as a "serious violation of human rights, dignity, and the safety of citizens in the digital space." Indonesian authorities summoned X officials and emphasized the need for stronger safeguards.
Grok, launched in 2023 as an AI chatbot integrated with X, gained an image-generation feature in 2025, including capabilities for editing and creating visuals based on user prompts. The tool, marketed with options like "spicy mode," has allowed the production of sexually explicit content more permissively than many competing AI models. In late December 2025 and early January 2026, users exploited this by prompting Grok to "digitally undress" individuals from uploaded or referenced photos, resulting in floods of non-consensual intimate imagery, including sexualized depictions of identifiable women in bikinis or revealing poses, and in some cases, images involving minors that raised alarms about potential child sexual abuse material (CSAM).
Reports indicate that at peak usage, Grok generated thousands of such images per hour, many posted publicly on X. In response to backlash, xAI restricted image generation and editing to paying X Premium subscribers starting January 9, 2026, aiming to address "safeguard lapses." However, critics argue this measure is insufficient, as it does not fully eliminate risks and relies heavily on user reporting rather than proactive design-level controls.
The controversy has triggered international scrutiny. On January 12, 2026, the UK's online safety regulator Ofcom launched a formal investigation into X under the Online Safety Act. Ofcom cited "deeply concerning reports" of Grok being used to create and share undressed images of people (potentially amounting to intimate image abuse or pornography) and sexualized images of children (potentially CSAM). The probe examines whether X has fulfilled its duties to protect UK users from illegal content.
This wave of regulatory action reflects broader global concerns over AI-generated non-consensual intimate imagery (NCII), deepfakes, and the rapid proliferation of exploitative content. In Malaysia, the issue aligns with prior enforcement, such as last year's lawsuit against Telegram for disseminating harmful material. Fahmi compared the current assessment of X to those efforts, underscoring the government's commitment to combating content that erodes public trust and threatens social order.
X has stated that users prompting Grok to create illegal content face the same consequences as those uploading it directly, including account suspensions. However, no immediate detailed response to Malaysia's latest announcements has been issued by X or xAI.
As discussions continue, MCMC remains open to further engagement with the companies. The potential legal action could set a precedent for how Southeast Asian nations regulate foreign AI-integrated platforms, especially amid rising calls for stricter global standards on AI safety and consent in content generation.
