this post was submitted on 18 Aug 2024

138 points (85.2% liked)

News

36143 readers

3673 users here now

Welcome to the News community!

Rules:

1. Be civil

Attack the argument, not the person. No racism/sexism/bigotry. Good faith argumentation only. This includes accusing another user of being a bot or paid actor. Trolling is uncivil and is grounds for removal and/or a community ban. Do not respond to rule-breaking content; report it and move on.

2. All posts should contain a source (url) that is as reliable and unbiased as possible and must only contain one link.

Obvious biased sources will be removed at the mods’ discretion. Supporting links can be added in comments or posted separately but not to the post body. Sources may be checked for reliability using Wikipedia, MBFC, AdFontes, GroundNews, etc.

3. No bots, spam or self-promotion.

Only approved bots, which follow the guidelines for bots set by the instance, are allowed.

4. Post titles should be the same as the article used as source. Clickbait titles may be removed.

Posts which titles don’t match the source may be removed. If the site changed their headline, we may ask you to update the post title. Clickbait titles use hyperbolic language and do not accurately describe the article content. When necessary, post titles may be edited, clearly marked with [brackets], but may never be used to editorialize or comment on the content.

5. Only recent news is allowed.

Posts must be news from the most recent 30 days.

6. All posts must be news articles.

No opinion pieces, Listicles, editorials, videos, blogs, press releases, or celebrity gossip will be allowed. All posts will be judged on a case-by-case basis. Mods may use discretion to pre-approve videos or press releases from highly credible sources that provide unique, newsworthy content not available or possible in another format.

7. No duplicate posts.

If an article has already been posted, it will be removed. Different articles reporting on the same subject are permitted. If the post that matches your post is very old, we refer you to rule 5.

8. Misinformation is prohibited.

Misinformation / propaganda is strictly prohibited. Any comment or post containing or linking to misinformation will be removed. If you feel that your post has been removed in error, credible sources must be provided.

9. No link shorteners or news aggregators.

All posts must link to original article sources. You may include archival links in the post description. News aggregators such as Yahoo, Google, Hacker News, etc. should be avoided in favor of the original source link. Newswire services such as AP, Reuters, or AFP, are frequently republished and may be shared from other credible sources.

10. Don't copy entire article in your post body

For copyright reasons, you are not allowed to copy an entire article into your post body. This is an instance wide rule, that is strictly enforced in this community.

founded 2 years ago

MODERATORS

JonsJava@lemmy.world

gedaliyah@lemmy.world

little_cow@lemmy.world

138

Soliciting Feedback for Improvements to the Media Bias Fact Checker Bot (lemmy.world)

submitted 2 years ago by jeffw@lemmy.world to c/news@lemmy.world

210 comments fedilink hide all child comments

Hi all!

As many of you have noticed, many Lemmy.World communities introduced a bot: @MediaBiasFactChecker@lemmy.world. This bot was introduced because modding can be pretty tough work at times and we are all just volunteers with regular lives. It has been helpful and we would like to keep it around in one form or another.

The !news@lemmy.world mods want to give the community a chance to voice their thoughts on some potential changes to the MBFC bot. We have heard concerns that tend to fall into a few buckets. The most common concern we’ve heard is that the bot’s comment is too long. To address this, we’ve implemented a spoiler tag so that users need to click to see more information. We’ve also cut wording about donations that people argued made the bot feel like an ad.

Another common concern people have is with MBFC’s definition of “left” and “right,” which tend to be influenced by the American Overton window. Similarly, some have expressed that they feel MBFC’s process of rating reliability and credibility is opaque and/or subjective. To address this, we have discussed creating our own open source system of scoring news sources. We would essentially start with third-party ratings, including MBFC, and create an aggregate rating. We could also open a path for users to vote, so that any rating would reflect our instance’s opinions of a source. We would love to hear your thoughts on this, as well as suggestions for sources that rate news outlets’ bias, reliability, and/or credibility. Feel free to use this thread to share other constructive criticism about the bot too.

you are viewing a single comment's thread
view the rest of the comments

[–] Five@slrpnk.net 18 points 2 years ago* (last edited 2 years ago) (1 children)

Sorry, no mea culpa. Let me elaborate. Van Zandt claims to value IFCN fact-checkers in his ratings, then he uses that laundered credibility to gatekeep minority and politically inconvenient voices. Here's a recent example brought to my attention.

It should be noted that despite no non-partisan fact checkers are listed on MBFC's site as raising concerns about the The Cradle's credibility, Van Zandt has arbitrarily placed it in the "Factual Reporting: Mixed" and "Credibility: Medium" categories. The concerns he posits about The Cradle's 'lack of transparency, poor sourcing," and one-sidedness clearly apply to the weird right-wing guy who makes these opaque decisions about journalistic value.

If IFCN fact-checkers have issues with sources he'd like to denigrate, he's happy to list them even if they've since been resolved. But they don't make up the central criteria for his 'methodology' as he'd like you to believe. Meanwhile he's free to make unreferenced claims about the credibility of others that uncareful readers take completely at face value.

All the concerns I have about The Cradle's credibility have been developed in spite of MBFC, which is the opposite of what you want if your goal is accountability and media literacy. And thanks to their reliance on this charlatan, LW!news have recently punted what I think is a valuable report.

[+] breakfastmtn@lemmy.ca -13 points 2 years ago

Sorry, no mea culpa.

If you think being an unrepentant liar is good for your cred, fill your boots, I guess.

It should be noted that despite no non-partisan fact checkers are listed on MBFC’s site as raising concerns about the The Cradle’s credibility, Van Zandt has arbitrarily placed it in the “Factual Reporting: Mixed” and “Credibility: Medium” categories. The concerns he posits about The Cradle’s 'lack of transparency, poor sourcing," and one-sidedness clearly apply to the weird right-wing guy who makes these opaque decisions about journalistic value.

'I don't understand how it works so it's stupid!'

The Cradle is a rag that's been banned by Wikipedia for publishing conspiracy theories and for (gasp!) poor sourcing.
If you had read their methodology, you'd know that MBFC wasn't being arbitrary as lack of transparency and the impact are clearly defined:

A source is considered to lack transparency if it fails to provide an ‘About’ page or a clear description of its mission. Transparency is further compromised if the ownership of the source is not openly disclosed, including the identification of the parent company and key individuals involved. Additionally, the absence of information about major donors, funding sources, or general revenue generation methods contributes to this lack of transparency. It is essential for the source to at least disclose the country, state, or city of operation and the name of the person responsible (such as the editor). While providing a physical address is not mandatory, meeting some of these transparency criteria is important. Inadequate transparency typically results in the source’s factual reporting rating being reduced by one or two levels, depending on the extent of the shortfall.

Credibility Levels:

High Credibility: A score of 6 or above.
Medium Credibility: A score between 3-5 points. Sources lacking an ‘About’ page or ownership information are automatically rated as Medium Credibility.
Low Credibility: A score of 0-2 points. Sources rated as Questionable, Conspiracy, or Pseudoscience are automatically classified as Low Credibility.

This is from the report:

The Cradle lacks transparency as they do not disclose ownership. The domain is registered in the United States.

Who could've seen that rating coming?

Methodical is the opposite of arbitrary. The reason it seems arbitrary to you is that you don't understand it. As a bare minimum to be critical of MBFC you should understand how it works, understand their methodology, and probably have read their Wikipedia page. Bonus points for seeing what high quality research says about them (spoiler alert: it says you're wrong). You're demanding that people take very seriously your misinterpretations and assumptions about something you don't understand. How is that a reasonable request?