this post was submitted on 12 Nov 2023
1 points (100.0% liked)

NFL

50 readers
3 users here now

A place for NFL news, game highlights and everything that excites you about American Football.

founded 11 months ago
MODERATORS
 

In this article, we are going to look into the influence referees and penalties have on a typical NFL game and season.  First, all the penalty data comes from nflpenalties.com.  If you would like to reveiw any of the data here, or data going back 10 years, you can do so on their site.

Let's break this article down into 2 parts:

  • What influence do penalties have on the game?
  • What penalties are being called this season in comparison to pervious seasons?

If you would like to read more about the penalty research issues & fixes, the full article is posted here:

NFL 2023 - Referees & Penalties Midseason Report

NFL 2023 Penalties by team

What influence do penalties have on an NFL Game?

First we should try to use the data to determine the amount penalties influence the outcome of NFL games.  To do that we are going to look at two charts:

  • Win % by Penalty Calls Differential
  • Win % by Penalty Yardage Differential

Let's start with Win % based on the difference of total penalties called against each team.  In the chart below you will see the penalty differnces , amount of  times a difference occured, team records, & Win %.

Win % by Penalty Amount Difference

Look at the range from 8 Fewer to 8 More in the win % column.  You will see almost a direct relationship between penalty difference and Win %.  The less penalties called against a team, the higher its chances of winning.  Outside the 8 Fewer to 8  More range we get into smaller sample sizes, so we are going to see more chaos in the records & Win % numbers

How about the relationship between Penalty Yardage and Win %, will we see the same thing there?

We have many small ranges in this chart so we are going to see a bit of chaos, but again if you look from 60-64 Fewer to 60-64 More range, you will again see a strong correlation between Win % and penalty yardage differential.

Win % by Penalty Yardage Difference

Therefore, the amount penalties called against a team, and/or the more penalty yardage called against a team relative its opponent, can swing Win % about 10% in either direction.   Thus this +/- 10% influence is about the influence referees can have on any single game, assuming they dont go completely flag crazy against one team.

What penalties are being called this season in comparison to previous seasons?

The following chart will show NFL Penalties over the past 5 years broken down by quarter, offense, defense, ST, amount of penalties and penalty yardage.  As you can see, if we project out the 2023 penalties, we are headed for the most penalties called in a season since 2019, and the most penalties called on the defense since 2020.  So it is fair to say, based on the projections, that referees are having more of an influence in 2023 than they have had since at least 2020.

NFL Penalties 2019 - 2023

If they are calling more penalties, what kind of penalties are the calling more of & when are they calling them?

This is the sticky wicket.  Different penalties have different punishments.  All are punished by yardage, but some grant automatic first downs.  However,  automatic 1st down penalties are the drive changers.  When they are taking place late in a game, it is going to appear as though, and in fact it actually may be, a game that is unduly influenced by penalties.

Look a the amount of penalties called in the 4th quarter thus far in 2023(445).  This projects out to about 900 4th quarter penalties in 2023, which again would be the most in the 4th quarter since 2019.

The real damning information comes in form of the following charts. The first is Automatic First Down Passing Penalties FOR each team.  In this chart the team listed is the beneficiary of an automatic 1st down penalty via the 4 main types of defensive passing penalties: Defensive Holding, Defensive Pass Interference, Illegal Contact, & Roughing the Passer.

As we can see, Tennessee has benefitted the most and Chicago has benefitted the least.  And there is a large difference between teams that benefitted most vs teams that have benefitted least.

Automatic 1st Down Penalties FOR

Here is the same chart but now we are looking at automatic 1st penalties AGAINST each team

Automatic 1st Down Penalties AGAINST

Below is a chart showing NET automatic 1st down penalties by team(FOR - AGAINST).  It is sorted from team most punished to most helped.  Since all these penalties come with auto 1st down, the Total column shows the amount of free 1st downs a team has given away(negative#) or gained(positive #).

NFL 2023 NET automatic first down penalties

Now I am simply going to repost one chart with 2022 and extrapolated 2023 data. This should allow us to see changes in amount/type of calls between 2022 & 2023.

Automatic First Down Penalty Calls 2022 vs 2023

So in 2022, there were 610 of these types of penalties called against the defense for a total of 6529 yards.

In 2023, there are projected to be 695 types of these penalties called for a total of 7348 yards.

The changes:

  • Total calls - up from 2.24 calls to 2.56 calls, an increase of 13.95%
  • Defensive Holding calls - Down 10.87%
  • Defensive Pass Interfence calls - Up 27.98%
  • Illegal Contact calls - Up 26.30%
  • Roughing the Passer calls - Up 27.82%

So while one of the 4 calls is showing a decrease of just under 11%, it is the least damaging penalty(along with Illegal Contact) among the four.  Meanwhile, the most damaging types of calls, Pass Interference & Roughing the Passer are both up nearly 28%(as is illegal contact).  Essentially all the referees have done is changed a few of the defensive holding calls into illegal contact calls.  While at the same time throwing a fairly massive increase of supremely damaging defensive penalties.

And if we simply combine this information, with the information about 4th quarter penalties being up, it means the referees are throwing more of the most damaging types of defensive passing penalties in 2023 than they have since at least 2020.  By doing this they are going to put there influence on games at the very edges of that +/- 10%, as opposed to having less influence over outcomes this year.

Enjoy your football Sunday & best of luck to your team. They may need it.

top 48 comments
sorted by: hot top controversial new old
[–] bonguivi@alien.top 1 points 10 months ago

Excellent content thanks OP

[–] Coonquistadoor@alien.top 1 points 10 months ago (2 children)

Good analysis! At first I was just chalking it up to undisciplined (i.e., bad) teams playing badly and getting punished as a result. But the increase in impactful penalties called in the 4th is oddly both higher and broadly consistent in terms of rate.

But I also find it interesting that it doesn’t correlate very strongly with overall team records. Some of the best teams are among the more punished, and some of the worst teams are among the most benefited. It impacts individual games, but not individual teams. If I gambled, I would be concerned.

[–] practicalist@alien.top 1 points 10 months ago (1 children)

You are absolutely correct regarding records(not sure whether you ran this or felt it)

The combined record for the Top 16 Most Negatively Impacted By Auto 1st Down Penalties: 70 - 69

The record for the the Top 16 teams that have benefitted most by auto first down penalties: 67 - 68

Statistical Gold Star for you sir!

[–] Coonquistadoor@alien.top 1 points 10 months ago

Didn't run it, just looked at the data. You laid things out really well so the visualization on its own was enough to get an accurate feel just by looking. So kudos goes to you really!

[–] Ndi_Omuntu@alien.top 1 points 10 months ago

My intuition generally feels like the goal is close games, not necessarily helping certain teams. It'd be interesting to see a break down of what calls kept a losing team in the game in the 4th quarter. Keep those eye balls on the game (and ads) as long as possible.

[–] Late_Pool_5425@alien.top 1 points 10 months ago
[–] Late_Pool_5425@alien.top 1 points 10 months ago

So many questions.

Correlations between certain crews and certain teams? Or game script (eg crew gets flag happy when margin between two teams reaches certain number). Or timing (eg more at end of game? More flags if game length unusually short so they can fill tv slot).

Hochulli is sketchy in my gut.

[–] thingsandstufffs666@alien.top 1 points 10 months ago (1 children)

Can I get a "too long and I'm too dumb for this level of rocket surgery physics" version?

[–] Couldof_wouldof@alien.top 1 points 10 months ago

Bad teams are more likely to commit penalties. Penalties are detrimental. This graph is intended to try and push the blame on the referees because it's easier than admitting that bad teams play bad football.

[–] Late_Pool_5425@alien.top 1 points 10 months ago (1 children)

You mention a ten percent impact by officials. Can we put that into perspective. Like for example how much percentage is home field or not having a turn over or a 100 yard rusher etc.

[–] practicalist@alien.top 1 points 10 months ago (1 children)

I can try. Here is a poorly formatted chart that converts point spreads into win%. Note that a 3 point favorite is considered to have 59.4% win %. link to chart https://www.boydsbets.com/nfl-spread-to-moneyline-conversion/

Home field advantage is often calculated as 3 points. So if we take that concept one step further down the line....

If referees were influencing games at around the +/-10% mark, they would be roughly adding or subtracting 3 points to the final score.

Point Spread Fav Win % Fav ML Dog Win % Dog ML

0 50.00% -100 50.00% +100

0.5 50.00% -100 50.00% +100

1 51.30% -105 48.80% +105

1.5 52.50% -111 47.50% +111

2 53.50% -115 46.50% +115

2.5 54.50% -120 45.50% +120

3 59.40% -146 40.60% +146

3.5 64.30% -180 35.70% +180

4 65.80% -192 34.20% +192

[–] Jurph@alien.top 1 points 10 months ago

Win percentage is one interesting metric, but correlating calls-to-WP seems convoluted... fraught with the potential to identify correlation without causation. Could you take the before-and-after outcomes, and look at the change in that play's EPA or instantaneous WP?

For instance, a sack on 3rd down in the red zone turns the EPA (4th down, ~20 yards out) into a solid +2.5 points -- there will be a FG and a change of possession -- but if that sack is overturned by roughing, it turns into basically first and goal, an EPA of +6.0 (TD likely). That's a single call, pure judgment. Deep-ball DPI is another one in the same category.

Those high-leverage calls make the game no fun for either team -- it robs the winner of believing they were victorious through skill, and robs the loser of any hope that skill could have won the day.

[–] FloralAlyssa@alien.top 1 points 10 months ago (2 children)

Total penalties are 3rd and defensive penalties are 2nd/3rd of the 5 years in the study, but somehow the refs are calling too many penalties?

I suspect the same is going to be true of the AFD penalties


it's going to be a nothing burger if you look at it over a period of time. You can find data to support a lot of conclusions.

Is the 2022 data through week 9, or full season? (It looks like full season in the initial charts). If so, you are comparing different things - as we get later the season there are fewer penalties:

2002:

Week 1: 204
Week 5: 201
Week 9: 135 (166 scaled to 16 games)
Week 13: 153 (163 scaled to 16 games)
Week 17: 158

2022 full year average was 177 / 16 games.

Do the refs suck? Yes, it's an impossible job and the NFL refuses to do the obvious thing and have a replay official in the booth that can call down in 15 second before the next play and say 'that wasn't a hold' or 'you missed a facemask', and that's dumb.

But let's be real, they aren't doing it to screw any teams, and they aren't worse about it than prior years. They just don't have enough people and/or the technology made available to them to see and call everything that goes on during the modern day game.

[–] gokism@alien.top 1 points 10 months ago

They just don't have enough people and/or the technology made available to them to see and call everything that goes on during the modern day game.

We don't know if the refs have asked or refuse to use the latest technology or for an additional ref on the field. We also don't know if the NFL wants to keep the traditional aspects of the game like the chain gang. We don't know why the NFL has the money to modernize the game to eliminate many of the issues yet refuses to adapt quickly.

It does look suspicious when millions of dollars are bet on games and the NFL doesn't want to shore up the integrity of the game through technology.

[–] practicalist@alien.top 1 points 10 months ago

Hi Alyssa! Nice to see you on the thread 8-)

If you read this as me implying the refs are purposely screwing the Saints, or secretly placing wagers on the Jags, then I messed up somewhere, and its my bad. Sorry bout that.

I agree with the decelerating penalties theory, but I believe it is especially prevelent when the NFL introduces a new protection rule(i think maybe 2020 & 2022 were last two years). I was not aware of a crackdown or implementation of new safety rules this year. In fact I would say they are simply enforcing the rules of 2020 & 2022 more often, and at times, incorrectly.

As far as complaining about too many penalties, that was not the aim of the article at all. It was to show there was a marked increase in a particularly damaging type of penalty and the timing of them. And while I agree we both can get the stats to say anything we want in the end, the statistics and math used do support the claim of a significant increase in 4th quarter auto 1st down passing penalties thus far this season.

Hope you have a nice week and good luck to your team!

[–] LORadSpurs@alien.top 1 points 10 months ago

When I found out most of the NFL referees are also lawyers with law firms of their own, I began to suspect there was a complex match fixing scheme going on.

[–] acoasterlovered@alien.top 1 points 10 months ago

We will have REFBALL and we will like it!

[–] TrickiestToast@alien.top 1 points 10 months ago

Glad to see some stats for my boys in stripes on where they can improve. They’re the reason we watch.

[–] pickleparty16@alien.top 1 points 10 months ago (1 children)

I wish broadcasts and other media talked about penalty stats similar to other stats. There's only like 1 website that actually tracks penalty data like this and most people don't know about it.

The average r/nfl poster is going to be shocked to see KC with no RTP calls and middle of the pack in automatic first down. People think KC gets more help from the refs when its simply not true. It won't change their firmly set belief op, but it will be a temporary moment of confusion.

[–] AlarmingAardvark@alien.top 1 points 10 months ago (1 children)

People think KC gets more help from the refs

No, people think KC gets help from the refs when they need it. They're a great team, so obviously only need it in certain situations.

Nobody expects KC to get more calls when they're already blowing out the Chargers in a W5 game. They do care a bit more when KC is gifted a free AFCCG win against the Bengals for an unnecessary roughness penalty that was no more egregious than the roughing the passer that wasn't called against them the drive (or two?) before.

I also expect that if you went through every play run by Travis Kelce and compared it to every play run by Rob Gronkowski, you would see massive reffing favouritism for Kelce.

[–] Admiral_Fuckwit@alien.top 1 points 10 months ago

The only thing that gets me about the Chiefs is the large amount of drive-extending holding/defensive passive interference calls they seem to get on 3rd/4th down after an incompletion.

I think I’ve lost count of how many times I’ve seen Mahomes do the “Mahomes point” the last 2 seasons. The Chiefs may not get more penalty calls in their favor, but they do seem to come at all the right times. Dunno if that’s my own bias tho 🤷‍♂️

[–] Colemans@alien.top 1 points 10 months ago

Not trying to be rude to anyone, but do you think the age of the Refs correlate to anything? Just watching games recently, it seems like most of them look to be in their 50s and even 60s. I'm not trying to be an ageist or whatever, but it seems like some younger refs in their 30s might have better vision to see what's going on, or be more "in tune" with the current game and fans. Again, I'm not trying to offend anyone, it just seems like getting some younger refs might literally help them see the game better

[–] FreeDig1758@alien.top 1 points 10 months ago (1 children)

What's interesting here to me, based on the lions, they don't FEEL like they are getting hosed as much as they used to.

But looking at this info, they are still getting hosed by the refs.

The biggest difference for them, in my opinion, is they aren't letting the penalties bring them down and change the game.

With the sol, a bad penalty just completely decimated them. Now they don't seem to be as negatively affected.

But yeah, they're still getting hosed.

[–] Hammerhead34@alien.top 1 points 10 months ago

It means you’re a good team. It’s part of the reason people seem to think the Chiefs get more gamechanging calls despite zero factual evidence to corroborate.

Because when bad calls go against us, we overcome them and when we receive bad calls in our favor we’re good enough to capitalize on them.

[–] devadander23@alien.top 1 points 10 months ago

Statistical evidence that the bears haven’t gotten calls all season. Who knew

[–] theboxturtle57@alien.top 1 points 10 months ago

Just looking back at the Bills Giants game makes me sad along with a lot of other things going on this year.

[–] DeadliftDingo@alien.top 1 points 10 months ago

I'll show this to my wife when she asks why I'm drinking more than usual this season, as I wipe the tears from my eyes with losing bet slips because of these zebra bastards.

[–] SlaveKnightLance@alien.top 1 points 10 months ago

“But why would the Jaguars just all of a sudden be the NFLs sweetheart team!?!??! We have never and will never get calls in our favor!!!!”

Gas lighting motherfuckers, Tlaw and Goodell catch up in the back of Waffle House

[–] yourmominabucket@alien.top 1 points 10 months ago (1 children)

If net is = to for - against, how does Houston end up with 0, how does Dallas end up 5? Am I missing some step in the calculation?

[–] practicalist@alien.top 1 points 10 months ago

there was an incorrect chart posted at one point. You may have been deceived by my posting ineptitude.

it was showing all auto 1st down penalties by down instead of by type and was same color and size and I missed it. sorry bout that. The correct chart is in place now.

[–] DolanDukIsMe@alien.top 1 points 10 months ago

Your telling me KC is just middle of the pack? Aw man I wanted that super bowl really bad.

[–] LeadSledPoodle@alien.top 1 points 10 months ago

The simple question to ask on RTP is how many QBs suffered injuries on hits that were (or should have been) penalties? The answer should tell us if the league has gone to far.

[–] accountforeddit@alien.top 1 points 10 months ago

It started in the AFCCG and Super Bowl, so I hope you're including those games for 'this year'.

[–] ClubPenguinPresident@alien.top 1 points 10 months ago

Amazing analysis. Now we have to keep going and investigate ref crews, ref names, who is penalizing which teams the most, refs who refuse to call obvious penalties (Last pass in the Giants/Bills game), etc

[–] BlameMattCanada@alien.top 1 points 10 months ago

Whatever man as a refs fan this has been their best year yet. Definitely see them making it to the big one and fucking up some major calls this year

[–] Inside-Big-8158@alien.top 1 points 10 months ago

Refs should be fined for bad calls that impact a game

[–] secrets_agent_Man@alien.top 1 points 10 months ago

This is Vegas's influence

[–] Tough-Cabinet@alien.top 1 points 10 months ago

This actually convinced me the league’s Not crooked because nobody wants to see Tennessee in a Super Bowl

[–] waconaty4eva@alien.top 1 points 10 months ago

Yet isn’r scoring is down?

[–] Otto_von_Grotto@alien.top 1 points 10 months ago

The league is being very soft on Jacksonville.

[–] Thunderkleize@alien.top 1 points 10 months ago

Not a lot of Jags fans in here

[–] Frostlike2816@alien.top 1 points 10 months ago

Nitpick: your third image's "Team Percentage" column is in decimal. BOOOOOO!

[–] tsgram@alien.top 1 points 10 months ago

This is all a distraction. The NFL WANTS us to complain about and blame reffing so we don’t notice why the games actually suck and seem so random: The coaching and players suck. We’ve got Tommy Devito and Clay Tune starting games. The Jets are one QB shy of being a contender, but their dick owner is buddies with Zach Wilson’s family so I guess flush the season down the toilet. Tua just takes fourth down sacks when they’re losing to preserve his stats, and he’s still going to get MVP votes. Someone recently hired Josh fucken McDaniels as a head coach. Texans let a chaplain run their team for a while. How many fourth down and clock management blunders have there been? This is absolute malpractice that a company so large can be run by such buffoons.

[–] joemax4boxseat@alien.top 1 points 10 months ago

Until refs can call RTP correctly, QBs should just play under flag-football rules. Seems every weak we see multiple weak-ass RTP calls where the QB was barely grazed yet the refs call it like they were murdered.

[–] No-Computer-2847@alien.top 1 points 10 months ago

I didn’t need stats to know the Bears have been screwed by the refs every week, but I’m glad they’re showing it anyway.

[–] abandon_soon@alien.top 1 points 10 months ago

Ok but here’s a fundamental question:

Is this a change in referring or a change in playing style / ability? Is there a way to determine, empirically, if players are actually committing penalties and an increased rate - as opposed to simply being called for more penalties?

Also, are there teams that are just actually more disciplined and commit fewer penalties?

And one final question, only semi-related:

WHY DO DBs WEAR BRIGHT-COLORED GLOVES???????? If you wanna get away with holding, don’t wear bright yellow gloves!!

[–] JimmyTheJimJimson@alien.top 1 points 10 months ago

It’s why the NFL is classified as “entertainment” and not sports.

It’s fixed. Sometimes subtly, sometimes obviously.

[–] c0smichero@alien.top 1 points 10 months ago

Jags fans shit all over themselves when they didn't get any ref help against the Chiefs last year. I see why 😂