this post was submitted on 18 Dec 2023
283 points (93.0% liked)

Technology

59219 readers
4492 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

Data poisoning: how artists are sabotaging AI to take revenge on image generators::As AI developers indiscriminately suck up online content to train their models, artists are seeking ways to fight back.

you are viewing a single comment's thread
view the rest of the comments
[–] AVincentInSpace@pawb.social 4 points 10 months ago* (last edited 10 months ago) (2 children)

companies would stumble all over themselves to figure out how to get it to stop doing that before going live. source: they already are. see bing image generator appending "ethnically ambiguous" to every prompt it receives

it would be a herculean if not impossible effort on the artists' part only to watch the corpos scramble for max 2 weeks.

when will you people learn that you cannot fight AI by trying to poison it. there is nothing you can do that horny weebs haven't already done.

[–] General_Effort@lemmy.world 3 points 10 months ago

It can only target open source, so it wouldn't bother corpos at all. The people behind this object to not everything being owned and controlled. That's the whole point.

[–] HejMedDig@feddit.dk 1 points 10 months ago (1 children)

The Nightshade poisoning attack claims that it can corrupt a Stable Diffusion in less than 100 samples. Probably not to NSFW level. How easy it is to manufacture those 100 samples is not mentioned in the abstract

[–] AVincentInSpace@pawb.social 2 points 10 months ago* (last edited 10 months ago) (1 children)

yeah the operative word in that sentence is "claims"

I'd love nothing more than to be wrong, but after seeing how quickly Glaze got defeated (not only did it make the images nauseating for a human to look at despite claiming to be invisible, not even 48 hours after the official launch there was a neural network trained to reverse its effects automatically with like 95% accuracy), suffice to say my hopes aren't high.

[–] HejMedDig@feddit.dk 1 points 10 months ago

You seem to have more knowledge on this than me, I just read the article 🙂