this post was submitted on 20 Oct 2023
489 points (98.2% liked)
Technology
72932 readers
4649 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
People that are completely desensitized to that kind of stuff would probably not be very good at moderating it really.
Also this is a terrible job and I'd be very worried if a company was paying and enabling people who find that fun. It's horrible, but trauma is the normal outcome.
Sounds like the perfect job for AI
They used AI to flag the images but a human still had to search through them
I am of the kind that is very wary with what should or should not be an AI's job, and you know what, in this very particular case, I think I agree.
At least as a first filter, anyway.
Huge industries emerging in this field right now for everything from this type of social media moderation to helping fight CSAM more effectively so humans aren't having to be a frontline for that type of material. This is one area I can really, really get behind AI on and see a very valid use case that isn't just marketing hype like so many others. I know there's some great stuff happening just based on my own field of employment and being close to a few things in the works this year.
I feel sorry for whichever researchers are in charge of training and fine tuning those models.... ouch
Honestly I don't see an issue with it. If they can tell the difference between an image that should be moderated and one that shouldn't they can do the job and I seriously doubt the vast majority of people desensitized to that kind of content can't tell the difference. That's like the arguments that we shouldn't make graphic games or movies because people won't be able to tell the difference between them and reality. Not everyone can do every job and these people would be the perfect fit for it and we would spare others from getting hurt
Desensitized doesn't necessarily mean somebody doesn't have reactions to something. It just means they can compartmentalize those reactions and move forward and deal with the ramifications later.
EMTs, ER Doctors, and Nurses are largely desensitized to graphic trauma and can press through and get the job done. But that doesn't mean that they don't process those scenes later in both healthy and unhealthy ways (there's a few study out there that show ER staff have higher rates of alcoholism and substance abuse rates than the general public).
Tramua is trauma, whether you're desensitized or not.
It would be a highly unethical but interesting research to see if those people experience long-term consequences nevertheless. Or if being desensitizes really does give someone immunity.
Except, you know, we're talking people who are progressively desensitized to reality. So no, that's not comparable at all.