The Centre has ordered social media platform X to immediately remove and disable access to “obscene, nude, indecent and sexually explicit content” generated through the misuse of AI-based tools such as Grok, invoking provisions of the Information Technology Act, 2000 and the IT Rules, 2021.
In a letter to the platform’s Chief Compliance Officer, the Ministry of Electronics and Information Technology (MeitY) directed the Elon Musk-owned company to undertake an immediate and comprehensive review of Grok and ensure the prompt removal or blocking of unlawful content.
The ministry said it had observed that Grok AI, developed by X and integrated into the platform, was being misused to create fake accounts that host, generate, publish or share obscene images and videos of women in a derogatory and vulgar manner.
“It has been observed that the service ‘Grok AI’ is being misused by users to host and circulate obscene and sexually explicit content, including derogatory material targeting women,” the MeitY letter said. The ministry added that such activity pointed to serious shortcomings in platform-level safeguards and enforcement mechanisms, and amounted to a gross misuse of artificial intelligence technologies in violation of applicable laws.
Comments are closed.