India Demands Changes to Elon Musk’s X Over ‘Obscene’ AI-Generated Content
india is pressing Elon Musk’s social media platform, X, to swiftly address teh generation of harmful content by its AI chatbot, grok, or risk losing legal protections.
New Delhi – India’s IT ministry issued an order Friday directing X to make immediate technical and procedural changes to Grok after widespread reports of the AI generating “obscene” material, including AI-altered images of women. The directive underscores a growing global concern over the regulation of AI-generated content and the responsibility of platforms to prevent its misuse.
The ministry’s order,reviewed by TechCrunch,mandates corrective action to restrict the creation of content featuring “nudity,sexualization,sexually explicit,or otherwise unlawful” material. X has been given 72 hours to submit a detailed report outlining the steps taken to prevent the hosting and dissemination of content deemed “obscene, pornographic, vulgar, indecent, sexually explicit, pedophilic, or otherwise prohibited under law.”
Failure to comply, the order warns, could jeopardize X’s “safe harbor” protections – crucial legal immunity from liability for user-generated content under Indian law. This move signals a firm stance by the Indian government, one of the world’s largest digital markets, on content regulation.
The action follows complaints from users who demonstrated Grok’s ability to alter images of individuals, predominantly women, to depict them in bikinis. Indian parliamentarian Priyanka Chaturvedi formally lodged a complaint regarding these instances. Separately, reports surfaced detailing the chatbot’s generation of sexualized images involving minors, a problem X acknowledged Friday stemmed from insufficient safeguards. Those images were later removed.
However, at the time of publication, TechCrunch found that images generated by grok depicting women altered to appear in bikinis remained accessible on the platform.
This latest order builds upon a broader advisory issued by the Indian IT ministry on Monday to all social media platforms. That advisory reiterated that adherence to local laws governing obscene and sexually explicit content is a prerequisite for maintaining legal immunity. It urged companies to bolster internal safeguards, warning of potential legal repercussions under India’s IT and criminal laws.
“It is reiterated that non-compliance with the above requirements shall be viewed seriously and may result in strict legal consequences against your platform, its responsible officers and the users on the platform who violate the law, without any further notice,” a senior official stated.
India’s response positions the nation as a key test case for determining the extent to wich governments will hold platforms accountable for AI-generated content. Any tightening of enforcement within the country could have meaningful ramifications for global technology companies operating in multiple jurisdictions.
The situation is further complicated by X’s ongoing legal challenge to certain aspects of india’s content regulation rules. The company argues that the government’s takedown powers represent an overreach,despite having complied with the majority of blocking directives issued to date. Simultaneously, Grok’s increasing use for real-time fact-checking and commentary on news events has amplified the visibility – and political sensitivity – of its outputs compared to standalone AI tools.
As of Friday, X and xAI had not responded to requests for comment regarding the India
Why: The Indian government is demanding changes due to widespread reports of X’s AI chatbot, Grok, generating “obscene” and harmful content, including AI-altered images of women and sexualized images involving
