this post was submitted on 24 Oct 2023
1 points (100.0% liked)

Mastodon

23 readers
1 users here now

Mastodon is

Helpful links

Registrations for 'mastodon.social' are often closed, but you can learn more about Mastodon and register with another instance at joinmastodon.org. It doesn't matter which instance you register on - you can still follow anyone on any instance.

If you are looking for service providers that can host and manage an instance for you:

founded 1 year ago
MODERATORS
rglullis
1
Questions regarding Moderation (alien.top)
submitted 1 year ago by never_obey@alien.top to c/mastodon
9 comments fedilink hide all child comments
 

Hi

I am a computer science student and am just starting my masters thesis. My focus will be on content moderation (algorithms) and therefore I am currently exploring how some social media applications moderate content.

If I understand the docs correctly, content moderation on mastodon is all manual labor? I haven't read anything about automatic detection of Child Sexual Abuse Material (CSAM) for example which is a thing that most centralised platforms seem to do.

Another question which kind of goes in the same direction is reposting of already moderated content. For example a racist meme that was posted before. Are there any measures in place to detect this?

Thank you for your help!

you are viewing a single comment's thread
view the rest of the comments
[–] indiealexh@alien.top 1 points 1 year ago (2 children)

The apis exists to perform moderation via a separate application, so in theory automated content moderation is possible, but most servers are relatively small and funding limited. This means there is little motivation to develop or adopt automated moderation.

The primary mechanism of moderation if by excluding people who break rules. Someone on your server breaks a rule, you ban them. They move somewhere else, they break your rules there and the mods over there don't care, so you exclude that instance from your server. (Defederate)

It's a simple but pretty effective system.

I think a kind of spider style bot that can be used to flag instances with high levels of rule breaking to suggest ban lists might be effective, but all automoderation comes with some level of error and we should be wary.

[–] dbailey635@alien.top 1 points 1 year ago (1 children)

If APIs exists to perform moderation via a separate application, would it not be worthwhile for instances, or even concerned individuals and companies, to work together and create a single, common Mechanical Turk-style, or even (dare I say it) AI-based moderation SaaS that could also tie into the PhotoDNA system at scale?

[–] indiealexh@alien.top 1 points 1 year ago (1 children)

Maybe, but who's paying? And why are they releasing it to the public for free?

Companies want to make money. Individuals want to spend as little as they can.

Many Companies are also more recently pushing back against opensource because they can't license how they want to to maximize profit. So there is a few companies who would pay for such a thing and all it opensource but not many and they have other priorities.

Maybe bluesky or whatever will care enough...

[–] WinteriscomingXii@alien.top 1 points 1 year ago

What do you mean? There’s tools out there already. Lemmy had one made recently that helps with CSAM. Plus the Fedi is always touting donations as the way so why wouldn’t people donate if funds are needed?

[–] never_obey@alien.top 1 points 1 year ago

Thank you for your reply. Neat that there are already APIs which technically would enable some kind of automated moderation. But I understand that automation is critical. Especially since ML Algorithms have problems with context.