A sleepy town in southern Spain is in shock after it emerged that AI-generated naked images of young local girls had been circulating on social media without their knowledge.
The pictures were created using photos of the targeted girls fully clothed, many of them taken from their own social media accounts.
These were then processed by an application that generates an imagined image of the person without clothes on.
So far more than 20 girls, aged between 11 and 17, have come forward as victims of the app's use in or near Almendralejo, in the south-western province of Badajoz.
"One day my daughter came out of school and she said 'Mum there are photos circulating of me topless'," says María Blanco Rayo, the mother of a 14-year-old.
"I asked her if she had taken any photos of herself nude, and she said, 'No, Mum, these are fake photos of girls that are being created a lot right now and there are other girls in my class that this has happened to as well.'"
She says the parents of 28 girls affected have formed a support group in the town.
Spanish authorities have launched an investigation into the imagesPolice are now investigating and according to reports, at least 11 local boys have been identified as having involvement in either the creation of the images or their circulation via the WhatsApp and Telegram apps.
Investigators are also looking into the claim that an attempt was made to extort one of the girls by using a fake image of her.
The impact the images' circulation has had on the girls affected varies. Ms Blanco Rayo says her daughter is bearing up well, but that some girls "won't even leave their house".
Almendralejo is a picturesque town with a population of just over 30,000 which is known for its production of olives and red wine. But it's not used to the sudden attention this case has brought, making the town national headline news.
That's in great part because of the efforts of one of the girls' mothers, Miriam Al Adib. She's a gynaecologist who has used her already prominent social media profile to place this issue at the centre of Spanish public debate.
"I wanted to give the message: it's not your fault," Miriam Al Adib saysAlthough many of the AI images are believed to have been created over the summer, the case only came to light in recent days after Dr Adib posted a video reassuring the girls affected and their parents.
"We didn't know how many children had the images, if they had been uploaded to pornographic sites - we had all those fears," she says.
"When you are the victim of a crime, if you are robbed, for example, you file a complaint and you don't hide because the other person has caused you harm. But with crimes of a sexual nature the victim often feels shame and hides and feels responsible. So I wanted to give that message: it's not your fault."
The suspects in the case are aged between 12 and 14. Spanish law does not specifically cover the generation of images of a sexual nature when it involves adults, although the creation of such material using minors could be deemed child pornography.
Another possible charge would be for breaching privacy laws. In Spain, minors can only face criminal charges from the age of 14 upwards.
The case has caused concern even for local people who are not involved.
"Those of us who have kids are very worried," says Gema Lorenzo, a local woman who has a son, aged 16, and a daughter, aged 12.
"You're worried about two things: if you have a son you worry he might have done something like this; and if you have a daughter, you're even more worried, because it's an act of violence."
Francisco Javier Guerra, a local painter and decorator, says the parents of the boys involved are to blame. "They should have done something before, like take their phones away, or install an application that tells them what their children are doing with their phone."
This is not the first time such a case has become news in Spain. Earlier this year, AI-generated topless images of the singer Rosalía were posted on social media.
"Women from different parts of the world have written to me explaining that this has happened to them and they don't know what to do," says Miriam Al Adib.
"Right now this is happening across the world. The only difference is that in Almendralejo we have made a fuss about it."
The concern is that apps such as those used in Almendralejo are becoming increasingly commonplace.
Javier Izquierdo, head of children's protection in the national police's cyber-crime unit, told Spanish media that these kinds of crimes are no longer confined "to the guy who downloads child porn from the Dark Web or from some hidden internet forum".
He added: "That obviously is still going on, but now the new challenges we are facing are the access that minors have at such an early age [to such technology], such as in this case."
News
Welcome to the News community!
Rules:
1. Be civil
Attack the argument, not the person. No racism/sexism/bigotry. Good faith argumentation only. This includes accusing another user of being a bot or paid actor. Trolling is uncivil and is grounds for removal and/or a community ban. Do not respond to rule-breaking content; report it and move on.
2. All posts should contain a source (url) that is as reliable and unbiased as possible and must only contain one link.
Obvious right or left wing sources will be removed at the mods discretion. We have an actively updated blocklist, which you can see here: https://lemmy.world/post/2246130 if you feel like any website is missing, contact the mods. Supporting links can be added in comments or posted seperately but not to the post body.
3. No bots, spam or self-promotion.
Only approved bots, which follow the guidelines for bots set by the instance, are allowed.
4. Post titles should be the same as the article used as source.
Posts which titles don’t match the source won’t be removed, but the autoMod will notify you, and if your title misrepresents the original article, the post will be deleted. If the site changed their headline, the bot might still contact you, just ignore it, we won’t delete your post.
5. Only recent news is allowed.
Posts must be news from the most recent 30 days.
6. All posts must be news articles.
No opinion pieces, Listicles, editorials or celebrity gossip is allowed. All posts will be judged on a case-by-case basis.
7. No duplicate posts.
If a source you used was already posted by someone else, the autoMod will leave a message. Please remove your post if the autoMod is correct. If the post that matches your post is very old, we refer you to rule 5.
8. Misinformation is prohibited.
Misinformation / propaganda is strictly prohibited. Any comment or post containing or linking to misinformation will be removed. If you feel that your post has been removed in error, credible sources must be provided.
9. No link shorteners.
The auto mod will contact you if a link shortener is detected, please delete your post if they are right.
10. Don't copy entire article in your post body
For copyright reasons, you are not allowed to copy an entire article into your post body. This is an instance wide rule, that is strictly enforced in this community.
view the rest of the comments
I admire your positive thinking, but it may also provide plausible deniability for legitimate CSAM, by your own logic. Either way, I see this being used to bully, blackmail, or worse. It's not that we are going to stop AI development, nor that we should. Perhaps as it improves (remember, right now it's the worst it will ever be), we can teach AI to recognize when it may be used for purposes like creating realistic CSAM or other such material, and have it log or report such uses.
I honestly don't know the solution, but I don't see the world ever getting "ho-hum, it's all fake anyway" about minor involved pornography.
it will do neither. i generated pictures can usually be identified by eye alone, and some companies are starting to add an invisible watermark to their output
You guys are working with the idea that companies and organizations will be creating these AI tools. They will be bound by laws but random people of groups of people will not. It will only get worse.