I've been thinking of a new way to consider quarterback efficiency that encompasses more than the Passer Rating and is less convoluted than the QBR, which laypersons with limited time and video access cannot compile themselves.
My Quarterback Efficiency Rating (QER) includes all plays involving the quarterback, and adds the percentage of good plays (first downs and touchdowns) and subtracts the bad plays (interceptions, fumbles, sacks). First downs, touchdowns, and fumbles include not just passing plays, but runs as well.
I use first-down percentage instead of yards per play (or yards per pass) and completion percentage to measure efficiency because first-downs are a better indicator that the quarterback made the right play.
Stathead has data for all plays, including first-downs, dating back to 1994. I looked at 12 quarterbacks whose careers began since then who are also in the top 20 in career passing yards. I wanted to look at quarterbacks who put in a lot of miles and experienced different degrees of quality in offensive lines, receivers, coaching, and management. How closely would my Quarterback Efficiency Rating (QER) compare with the passer rating? How does it serve as a predictor of team success? Does the QER make sense?
The following chart lists these players in order of their career passer rating. At the you see their winning percentage rank and QER rank.
This would be an appropriate time to note that Aaron Rodgers, the all-time leader in passer rating, is the most-sacked quarterback of all time. Tom Brady has six fewer sacks but played 93 more games than Rodgers. Drew Brees and Peyton Manning also played more games than Rodgers, and respectively have 151 and 268 fewer sacks.
Sacks are the reason why Rodgers is only fourth in QER and significantly behind the top three of Peyton, Brees, and Brady. Carson Palmer (9th) is closer to Rodgers in QER than Rodgers is to Brady.
Russell Wilson, second in passer rating, has an even greater sack problem. He's been sacked 560 times, just 11 fewer than Rodgers, in 41 fewer games. As a result, he has the second-worst "bad play" percentage behind Philip Rivers, and falls all the way to tenth among the twelve listed in QER.
Sacks are often blamed on poor offensive line play and receivers not getting open. But how often does a quarterback have no chance of avoiding a sack? Ironically, Rodgers and Wilson, among these quarterbacks, are best-known for their relative athleticism and scrambling ability; one would think they would be the best at avoiding the pass rush.
Sacks are drive killers. I couldn't quickly locate the primary source with the data, but Ted Nguyen writes:
"[S]acks (including ones that don’t end in turnovers) are often drive killers. Derrik Klassen of Football Outsiders charted the 2016 season and found that only 179/1118 (16.01 percent) drives in which there was a sack eventually got another set of downs. 83.99 percent of drives were essentially killed by sacks."
2016 is a long time ago, but it's unlikely there's been a meaningful change in the data since. Teams still can't easily overcome sacks. Jason Lisk noted quarterbacks are pretty consistent with their completion percentage regardless of the talent around them, but sack rate is nearly as consistent.
Rodgers and Wilson just aren't very good at avoiding sacks. Yet sacks are ignored in the P[asser Rating statistic, which helped Rodgers win four MVPs and Wilson rack up ten Pro Bowls.
That said, Passer Rating is still a stronger predictor of team success than QER. The top five in passer rating among these twelve are in the top six in winning %, and the bottom four in passer rating are in the bottom five in winning %. There is a much weaker correlation when comparing QER rank to winning % rank.
That said, the QER generally looks right. The top four look right. The bottom two look right. Each of the six quarterbacks ranked 5-10 had, at times, been regarded as one of the five best quarterbacks in the league.
While Wilson's score and rank at tenth is the biggest surprise, perhaps that's only because we've underrated the importance of sacks and the quarterback's responsibility for them. My instinct is that he was better than his rank over most of his career. But he, like Roethlisberger, played for a strong organization for most of his career and thus won games at a high rate. Some others on the list have not always been so fortunate.
Quarterbacks can't be held responsible for everything.