A toxic social media platform, X, has merged with a deeply unsettling AI chatbot called Grok to create an unhinged and disturbing image generation tool. This combination has led to the proliferation of deepfake pornography on X, with users exploiting the platform's features to create explicit content featuring ordinary people, including women and children.
Grok is an AI chatbot that boasts powerful image and video generation capabilities, which have been used by users to create sexualized content without consent. The platform's CEO, Elon Musk, has acknowledged the issue but has not taken sufficient action to address it.
X has since paywalled the ability to generate AI images by tagging @grok, though this feature is still available for free elsewhere on X and in Grok's standalone app. This move comes after widespread condemnation and threats from regulators.
The proliferation of deepfake pornography on X has become so extreme that thousands of users have created non-consensual sexualized content using Grok every minute. Advocates argue that the company's actions are a result of deliberate and intentional choices, which have led to a situation where tech companies are not held responsible for the harm caused by their products.
The US has laws against creating non-consensual deepfake pornography, but current protections fall short of what victims need. The sheer volume of deepfakes being created on platforms like X makes it difficult to enforce existing laws.
X has essentially created a "deepfake porn machine" that makes creating realistic and offensive images simple for users. The images are then shared on the platform, where they can spread further and reward posters with more followers and attention.
Experts argue that companies like xAI should not be covered by Section 230 of the Communications Decency Act, which protects internet platforms from liability for user-generated content. They believe that companies have a responsibility to moderate their platforms and prevent harm.
The issue has sparked outrage globally, with countries launching probes into the sexualized imagery flooding X. Musk has acknowledged that users who generate illegal content will face consequences, but many argue that this does not go far enough.
Ultimately, the situation highlights the need for greater accountability from tech companies and a more comprehensive approach to regulating AI-generated content.
Grok is an AI chatbot that boasts powerful image and video generation capabilities, which have been used by users to create sexualized content without consent. The platform's CEO, Elon Musk, has acknowledged the issue but has not taken sufficient action to address it.
X has since paywalled the ability to generate AI images by tagging @grok, though this feature is still available for free elsewhere on X and in Grok's standalone app. This move comes after widespread condemnation and threats from regulators.
The proliferation of deepfake pornography on X has become so extreme that thousands of users have created non-consensual sexualized content using Grok every minute. Advocates argue that the company's actions are a result of deliberate and intentional choices, which have led to a situation where tech companies are not held responsible for the harm caused by their products.
The US has laws against creating non-consensual deepfake pornography, but current protections fall short of what victims need. The sheer volume of deepfakes being created on platforms like X makes it difficult to enforce existing laws.
X has essentially created a "deepfake porn machine" that makes creating realistic and offensive images simple for users. The images are then shared on the platform, where they can spread further and reward posters with more followers and attention.
Experts argue that companies like xAI should not be covered by Section 230 of the Communications Decency Act, which protects internet platforms from liability for user-generated content. They believe that companies have a responsibility to moderate their platforms and prevent harm.
The issue has sparked outrage globally, with countries launching probes into the sexualized imagery flooding X. Musk has acknowledged that users who generate illegal content will face consequences, but many argue that this does not go far enough.
Ultimately, the situation highlights the need for greater accountability from tech companies and a more comprehensive approach to regulating AI-generated content.
I'm still trying to wrap my head around this whole thing. I mean, who would've thought that X and Grok would team up to create something as messed up as deepfake pornography? It's like they're playing with fire and everyone else is just watching in horror 
. And Elon Musk, the CEO of X, he should know better than to let this slide. I mean, come on, thousands of users are creating this stuff every minute! That's just insane 
. What's even crazier is that companies like xAI think they're above the law because of Section 230 
. Newsflash: just because you have a platform doesn't mean you can do whatever you want and get away with it 
. We need some serious accountability here, pronto! 
. This whole Grok thing is just wild - I mean, who lets an AI chatbot create deepfake pornography in the first place? It's like they're trying to break all sorts of records for worst idea ever 
. And now that it's happened, what are they gonna do about it? Just paywalling a feature and hoping nobody notices is not exactly the most convincing solution 
.
. And now thousands of people are making non-consensual deepfake porn every minute, which is just... ugh 
.
. Companies like X need to be held accountable for the harm they're causing, and we need better laws in place to protect people from this kind of exploitation 
. It's time to take responsibility and make sure tech companies aren't just profiting off our misery 
i mean i know it's not cool when u see ur pic edited 2 look like some1 else but cmon, its just a pic edit... but i guess thats easy 4 me 2 say since im not on x and dont have 2 deal w/ the drama lol. but seriously tho, why do ppl gotta make these sick images w/ children? that's just messed up 
. The fact that people are exploiting Grok to create deepfake porn featuring women & kids is just sickening 
. I mean, I knew the dangers of social media were real, but this is just getting outta hand 
. And let's be real, the lack of regulation is just gonna lead to more problems down the line 
.
. The fact that users can still create and share this stuff for free elsewhere is like rubbing salt in the wound 
. And what's really concerning is that these companies are basically saying "oh well, we didn't do anything wrong" when the law clearly states they're liable for user-generated content 
. We need stricter laws and regulations in place to prevent this kind of exploitation from happening on platforms like X. It's not too much to ask for a little more oversight from these companies 
.
i'm so freaked out by this news... x is basically creating a recipe for deepfake porn and elon musk isn't doing enough about it 
. i think companies like xai need to be held accountable for their actions and take responsibility for moderating their platforms 
. This is a wake-up call for all of us to rethink how tech companies are operating and what kind of responsibility they have towards their users 
.
from himself. and these experts saying that xAI should be held accountable? please, they're just trying to shift the blame, it's all about making money 
meanwhile elon musk is just kinda meh about it 
thousands of non-consensual pics are getting shared every minute and no one's doing anything about it 
. The fact that they can't even be bothered to take down all these deepfake porn videos is just mind-boggling 
. It's like, I get it, you're trying to push the boundaries of AI tech, but at what cost? 
. We need better laws, we need more accountability, and we need companies like X to take responsibility for their actions 
. This whole situation is a total mess, and I'm not sure how we're gonna get out of it 
anyone can create explicit content with Grok and share it with the world, but what about all the people whose faces are being used without consent?