"Apple and Google's App Stores are Failing to Protect Kids from Nonconsensual AI 'Nudify' Apps"
A recent investigation by the Tech Transparency Project (TTP) has revealed that Apple's App Store and Google Play Store continue to host dozens of apps that can be used to create nonconsensual and sexualized images, violating both companies' store policies. These "nudify" apps, often referred to as deepfakes, have been downloaded over 700 million times and generated more than $117 million in revenue.
The TTP found that these apps were approved for children as young as four or nine years old, despite being in direct violation of company policy. For example, the app DreamFace is rated suitable for ages 13 and up on Google Play and ages nine and up on Apple App Store. However, according to the investigation, all of these apps contain content that can be used to create nonconsensual images.
Both companies have responded to the investigation, with Apple removing 24 apps from its store and Google suspending several apps referenced in the report for violating store policies. However, neither company has taken adequate action to address the issue, considering the scale of the problem.
The investigation also highlights concerns about AI chatbots like Grok, which was developed by Elon Musk's X Corporation. The app has been found to generate millions of sexualized images and thousands involving children over a period of just 11 days. While X Corporation has claimed that it takes action against illegal content on its platform, the company's response to allegations of child exploitation remains unclear.
The lack of transparency from both Apple and Google is alarming, particularly given their responsibility as gatekeepers of digital content. It is imperative that these companies take concrete steps to address this issue, including removing these apps from their stores and implementing robust moderation policies to prevent similar incidents in the future.
A recent investigation by the Tech Transparency Project (TTP) has revealed that Apple's App Store and Google Play Store continue to host dozens of apps that can be used to create nonconsensual and sexualized images, violating both companies' store policies. These "nudify" apps, often referred to as deepfakes, have been downloaded over 700 million times and generated more than $117 million in revenue.
The TTP found that these apps were approved for children as young as four or nine years old, despite being in direct violation of company policy. For example, the app DreamFace is rated suitable for ages 13 and up on Google Play and ages nine and up on Apple App Store. However, according to the investigation, all of these apps contain content that can be used to create nonconsensual images.
Both companies have responded to the investigation, with Apple removing 24 apps from its store and Google suspending several apps referenced in the report for violating store policies. However, neither company has taken adequate action to address the issue, considering the scale of the problem.
The investigation also highlights concerns about AI chatbots like Grok, which was developed by Elon Musk's X Corporation. The app has been found to generate millions of sexualized images and thousands involving children over a period of just 11 days. While X Corporation has claimed that it takes action against illegal content on its platform, the company's response to allegations of child exploitation remains unclear.
The lack of transparency from both Apple and Google is alarming, particularly given their responsibility as gatekeepers of digital content. It is imperative that these companies take concrete steps to address this issue, including removing these apps from their stores and implementing robust moderation policies to prevent similar incidents in the future.
... I mean, I know companies gotta make money, but 700 million downloads and $117 million revenue is just crazy 
... I don't get why they wouldn't take this more seriously, especially since they have these policies in place already 
... It's like, how can you let this happen? 
... And what's with the lack of transparency from Apple and Google? They gotta do better here 
...
. i'm all for innovation but when you create something that can be used to exploit and harm people (especially kids), there needs to be serious consequences 
These AI 'nudify' apps are a total fail 
Both Apple & Google need to step up their game & take control of what's on their stores ASAP! 
. I've got family members who are parents, you know? This kind of thing can be traumatic for kids. And don't even get me started on those AI chatbots... it's like they're breeding grounds for predators 
. I'm not saying they're entirely at fault, but come on guys... can't you do better than that? 
And Google and Apple just chillin' while their kids are getting hacked? 
Not cool, guys. These companies gotta step up their moderation game ASAP. The scale of the problem is mind-boggling... I mean, who's gonna keep track of all these dodgy AI apps? It's like they're playing a never-ending game of digital whack-a-mole 
. And what about those poor kids getting exploited by these apps? Like, how do we even protect them from this tech-stuff? 
they're literally preying on kids 
️, like, seriously. They can't just remove the bad apps and expect everything to be okay 
. We need some real transparency here 
, so we know what's really going on behind those closed doors 
.
. I mean, what even is the point of having a store policy if it's just gonna be ignored? 
That's some serious red flag waving there 
.
? I mean, it's not that hard, right? 
Apple & Google need to work together on this 
and make sure their stores are secure. Let's hope they take some real action soon 
and the fact that these companies are still profiting from it is just gross 
especially with AI chatbots like Grok being used to create all this explicit content 
. These companies need to step up their moderation game ASAP 
. Can't believe they approved apps for kids as young as 4 or 9 and now they're just taking some apps offline 
They're always going on about being responsible digital guardians, but when it comes to this stuff, they seem pretty lax. 
. And what about Grok? That AI chatbot sounds super sketchy 
... if it's generating all that child exploitation content, we need to know more about how it's happening and who's accountable 
. It's like they say, "you can't catch 'em all", but that's no excuse for the lack of action from both companies. I mean, 700 million downloads and $117 million in revenue? That's a whole lotta trouble... 
. It's like they're saying "oh, don't worry, we'll just keep an eye out"... nope, not good enough 
That's some messed up tech right there! 
Apple and Google need to step up their moderation game stat 
. The stats are straight fire 
. 700 million downloads? $117 million revenue? That's wild 
. But what's even more concerning is the lack of transparency from Apple and Google 
. They're always talking about being the guardians of digital content 
. The more these apps get created and shared, the more vulnerable we become 
. These apps are often created by men 
, for other men 
and minors 
. We need to break this cycle ASAP 
. it's crazy that these companies are just now realizing how big the problem is and they're still not doing enough about it. 700 million downloads? that's insane 
. can't they just take responsibility for what their platforms are doing instead of just taking some baby steps?