this post was submitted on 26 Oct 2023
62 points (73.5% liked)

Technology

59157 readers
2338 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

AI-created child sexual abuse images ‘threaten to overwhelm internet’::Internet Watch Foundation finds 3,000 AI-made abuse images breaking UK law

top 40 comments
sorted by: hot top controversial new old
[–] RotaryKeyboard@lemmy.sdf.org 86 points 1 year ago (3 children)

Holy hyperbole, batman! Threaten to overwhelm the internet!

Someone's hungry for clicks today, eh, The Guardian?

AI-generated CSAM is illegal under the Protection of Children Act 1978, which criminalises the taking, distribution and possession of an “indecent photograph or pseudo photograph” of a child.

Aaaand there you go. This is nothing new. There have been laws on the books for decades to help deal with this exact problem. Someone just slapped "AI" on the story to gin up worry.

[–] Bell@lemmy.world 55 points 1 year ago (1 children)

They are trying to gather support for the new invasions into your privacy that are required "to save the poor children"

[–] Eezyville@sh.itjust.works 31 points 1 year ago

Those poor AI children!

[–] stolid_agnostic@lemmy.ml 10 points 1 year ago* (last edited 1 year ago) (4 children)

I agree with your assessment wholly. There was a case in the US (don't recall the details) maybe 15 years ago or so where the "cp" was actually drawings of the Simpson's children nude. Judge held that it didn't matter if it was real or fake. This sort of thing isn't new.

I only came to comment that I would not have predicted that AI would be used this way, but am not at all surprised by it.

[–] there1snospoon@ttrpg.network 9 points 1 year ago (1 children)

would not have predicted

You must not have been on the internet for very long

[–] stolid_agnostic@lemmy.ml 3 points 1 year ago* (last edited 1 year ago) (1 children)

Probably longer than most people but I often make the mistake of believing that humans tend to strive for good in spite of everything that indicates otherwise.

[–] there1snospoon@ttrpg.network 2 points 1 year ago

Some do. Some don’t. There will always be bad actors.

[–] Stovetop@lemmy.world 6 points 1 year ago (1 children)

Didn't the Simpson's movie from 16 years ago get away with showing Bart's genitals? Are we still leaning on the "know it when I see it" definition of sexually explicit material?

[–] stolid_agnostic@lemmy.ml 2 points 1 year ago

They do it in Dragon Ball as well. I think the point is that if it's just passing nudity (i.e. a child being a child), then it's not sexual.

[–] Cypher@lemmy.world 3 points 1 year ago (1 children)

The judge was later found to be hosting CP on his personal website, of a very similar nature.

[–] baked_tea@lemmy.world 2 points 1 year ago

What the heeeell is this true?

[–] scottywh@lemmy.world 2 points 1 year ago

That was Australia, not the US.

Look under Australia in the following Wikipedia page.

https://en.m.wikipedia.org/wiki/Legal_status_of_fictional_pornography_depicting_minors

[–] Clent@lemmy.world 2 points 1 year ago

We were all worrying AI was going to murder us to save us from ourselves; turns out it's going to do it by literally burying us in CASM.

Asimov was wrong!

[–] Treczoks@lemm.ee 54 points 1 year ago (1 children)

"Flooding the internet" - my ass. With 3000 pictures. Which is absolutely nothing in todays world. Maybe flooding some pedophile niches in the darkest corners of the internet, maybe replacing pictures of real abuse there. Makes you wonder where this "Internet Watch Foundation" actually hangs out. And what they smoke when they write their press releases.

[–] banneryear1868@lemmy.world 4 points 1 year ago

"Overwhelm the internet" makes it sound like it's going to be flooding every website, but I don't see why they wouldn't deal with it the way they already do. A lot of these orgs try to be overly alarmist on purpose to attract political attention to their causes, but it creates distrust with people who aren't necessarily "in" on the org's operations and strategy.

[–] BetaDoggo_@lemmy.world 21 points 1 year ago

"Threaten to overwhelm", they found 3,000 images. By internet standards that's next to nothing. This is already illegal and it's fairly easy to filter out(or it would be if companies could train on the material legally).

[–] EatYouWell@lemmy.world 17 points 1 year ago (2 children)

Honestly, even though I find the idea abhorrent, if it prevents actual children from being abused...

I mean, the content is going to be generated one way or another.

[–] Plopp@lemmy.world 10 points 1 year ago

But the poor algorithms that are forced to generate the content!

[–] HeavyDogFeet@lemmy.world -2 points 1 year ago* (last edited 1 year ago) (2 children)

Does it? Or is it just bonus content for pedophiles? Just because they’re now getting thing B doesn’t mean they’re not also still getting thing A. In fact, there’s nothing to suggest that this wouldn’t just make things worse. What’s to stop them from simply using it like a sandbox to test out shit they’ve been too timid to do themselves in real life? Little allowances like this are actually a pretty common way for people to build up to committing bolder crimes. It’s a textbook pattern for serial killers, what’s to say it wouldn’t serve the same purpose here?

But hey, if it does result in less child abuse material being created, that’s great. But there’s no evidence that this is actually how it will play out. It’s just wishful thinking because people want to give generative AI the benefit of the doubt that it is a net positive for society.

Anyway, rant over. You might be able to tell that I have strong feelings about benefit and dangers of these tools.

[–] Igloojoe@lemm.ee 12 points 1 year ago (2 children)

Your argument sounds very similar to when people argue that video games promote violence and criminal activity.

[–] HeavyDogFeet@lemmy.world 1 points 1 year ago* (last edited 1 year ago)

That quite a stretch. For a start, playing video games isn’t illegal. Generating child porn is. Graduating from something innocent to something criminal is very different to starting off at one of the more heinous crimes in modern society and then continuing to do different variations of that same crime.

[–] hahattpro@lemmy.world 0 points 1 year ago

Yeah, you play Teris at kid, then you become series killer with a brick in adult.

Yikep

[–] burliman@lemm.ee 4 points 1 year ago (1 children)

I’m guessing they could easily support this with a simple premise: Examine a legal fetish, which AI can generate images of, and ask people who generate those images if their consumption of real images have fallen as a result. Also check if actual real life participation in it has been reduced due to the ability to generate the scenarios privately.

It will be skewed if the fetish is legal, since participating won’t land you in jail. But there may be some out there that present other risks besides legal ones to help with that.

[–] Heavybell@lemmy.world 1 points 1 year ago (1 children)

Where does the fact some people will happily jerk it exclusively to anime titty come into this, I wonder?

[–] Brahminman@iusearchlinux.fyi 1 points 1 year ago

It doesn't? They're a fucking edge case and if you only jerk it to anime then nobody will ever be harmed in the production of the port you watch, so nobody should care or read too much into it

[–] Luisp@lemmy.dbzer0.com 14 points 1 year ago

I miss when nfts were the bad thing everyone hated

[–] uriel238@lemmy.blahaj.zone 11 points 1 year ago* (last edited 1 year ago) (1 children)

Just as a general rule, when we develop a technology, someone in our society (typically rich people and limit-testers; also teens) will try doing the worst most abominable deeds with this tech until we learn there is a general good reason not to do that thing.

Hence, defective clones of aristocrats, deepfakes of school peers and AI child porn. This is just the beginning.

Fun Fact: NGOs have long been using 3D printers to create prototypes by which to smith Soviet-era guns to arm villages against regional warlords. As desktop manufacturing gets closer and closer to the home office, ad hoc arms production will be an inevitability.

[–] ouRKaoS@lemmy.today 6 points 1 year ago (1 children)

As desktop manufacturing gets closer and closer to the home office, ad hoc arms production wilk be an inevitability.

Do a quick Google for "FGC-9“

The future is now, old man!

[–] uriel238@lemmy.blahaj.zone 1 points 1 year ago
[–] autotldr@lemmings.world 7 points 1 year ago

This is the best summary I could come up with:


The “worst nightmares” about artificial intelligence-generated child sexual abuse images are coming true and threaten to overwhelm the internet, a safety watchdog has warned.

Other examples of child sexual abuse material (CSAM) included using AI tools to “nudify” pictures of clothed children found online.

Its latest findings were based on a month-long investigation into a child abuse forum on the dark web, a section of the internet that can only be accessed with a specialist browser.

The IWF said the vast majority of the illegal material it had found was in breach of the Protection of Children Act, with more than one in five of those images classified as category A, the most serious kind of content, which can depict rape and sexual torture.

Stability AI, the UK company behind Stable Diffusion, has said it “prohibits any misuse for illegal or immoral purposes across our platforms, and our policies are clear that this includes CSAM”.

The government has said AI-generated CSAM will be covered by the online safety bill, due to become law imminently, and that social media companies would be required to prevent it from appearing on their platforms.


The original article contains 561 words, the summary contains 190 words. Saved 66%. I'm a bot and I'm open source!

[–] hahattpro@lemmy.world 5 points 1 year ago (1 children)

So, this is where lolicon and shotaco live. Look optimistic, it is better for AI to endure the abuse rather than real human victim.

[–] HeavyDogFeet@lemmy.world 6 points 1 year ago

Sure, except there’s nothing to suggest that this stuff would reduce the number of real humans being abused.

[–] Mango@lemmy.world 1 points 1 year ago

Didn't people make the same fuss about Photoshop?

[–] bit_thanos@monero.town 1 points 1 year ago

I wonder who got all those images the algorithm got trained on?

[–] bloopernova@programming.dev -2 points 1 year ago

There is a potential for proliferation of CSAM generated by AI. While the big AI generators are centralized and kept clear of most bad stuff, eventually unrestricted versions will become widespread.

We already have deepfake porn of popular actresses, which I think is already harmful. There's also been sexually explicit deepfakes made of preteen and young teenage girls in Spain, and I think that's the first of many similar incidents to come.

I can't think of a way to prevent this happening without destroying major potential in AI.