this post was submitted on 02 Jul 2025
377 points (97.5% liked)

Technology

72865 readers
3598 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 

Schools and lawmakers are grappling with how to address a new form of peer-on-peer image-based sexual abuse that disproportionately targets girls.

(page 2) 50 comments
sorted by: hot top controversial new old
[–] danciestlobster@lemmy.zip 9 points 2 weeks ago (8 children)

I don't understand fully how this technology works, but, if people are using it to create sexual content of underage individuals, doesn't that mean the LLM would need to have been trained on sexual content of underage individuals? Seems like going after the company and whatever it's source material is would be the obvious choice here

[–] lime@feddit.nu 9 points 1 week ago* (last edited 1 week ago)

not necessarily. image generation models work on a more fine-grained scale than that. they can seamlessly combine related concepts, like "photograph"+"person"+"small"+"pose" and generate plausible material due to the fact that all of those concepts have features in common.

you can also use small add-on models trained on very little data (tens to hundreds of images, as compared to millions to billions for a full model) to "steer" the output of a model towards a particular style.

you can make even a fully legal model output illegal data.

all that being said, the base dataset that most of the stable diffusion family of models started out with in 2021 is medical in nature so there could very well be bad shit in there. it's like 12 billion images so it's hard to check, and even back with stable diffusion 1.0 there was less than a single bit of data in the final model per image in the data.

load more comments (7 replies)
[–] Regrettable_incident@lemmy.world 9 points 2 weeks ago (1 children)

Aren't there already laws against making child porn?

[–] cley_faye@lemmy.world 7 points 2 weeks ago (1 children)

I'd rather these laws be against abusing and exploiting child, as well as against ruining their lives. Not only that would be more helpful, it would also work in this case, since actual likeness are involved.

Alas, whether there's a law against that specific use case or not, it is somewhat difficult to police what people do in their home, without a third party whistleblower. Making more, impossible to apply laws for this specific case does not seem that useful.

load more comments (1 replies)
[–] SabinStargem@lemmy.today 5 points 1 week ago (3 children)

Deepfakes might end up being the modern version of a bikini. In the olden days, people wore these to the beach. Having less was scandalous and moral decay. Yet, now we wear much less.

Our grandchildren might simply not give a damn about their nudity, because it is assumed that everyone is deepfaking everyone.

load more comments (3 replies)
[–] PumpkinEscobar@lemmy.world 4 points 2 weeks ago

If kids want to be protected they need to get some better lobbyists. /s

[–] LovableSidekick@lemmy.world 4 points 2 weeks ago

Instead of laws keeping up It also might turn out to be a case where culture keeps up.

[–] MagicShel@lemmy.zip 3 points 2 weeks ago* (last edited 2 weeks ago) (6 children)

The only defense is to train AI to draw guys with micropenises. As long as kids being kids is a defense for this shit (and to be fair, kids are pretty fucking stupid and need the freedom to grow out of that) rule makers have no power here. At least insofar as the AI to do this can be run locally on a potato.

load more comments (6 replies)
load more comments
view more: ‹ prev next ›