And The Valley Shook: An SB Nation Community

Navigation: Jump to content areas:


Pro Quality. Fan Perspective.
Login-facebook
New Blog: Along The Olentangy for Ohio State Fans!

A Look at the 'And The Valley Shook Quarterback Productivity Index'

A month ago, a couple of gracious commenters agreed to help out  with compiling the data for a new feature I will be running, chronicling the And The Valley Shook Quarterback Productivity Index, or ATVSQBPI for short.  it is a replacement for the woefully inadequate "Passer Rating" statistic, which has come to criticism here.  I told you I'd go into this in more detail at another time, and here it is.

The passer rating is a great idea for a statistic.  The idea is to combine a number of important passing statistic into an index that can be ranked and evaluated.  The problem is that the college passer rating is not calculated in an intelligent way.  Here is the formula used to measure college quarterbacks (the formula for pro quarterbacks is different):

(100*Completions/attempts) + (8.4*yards/attempts) + (330*Touchdowns/attempts) - (200*Interceptions/attempt) = Passer rating

This looks all fine and dandy, but if you do a little algebra, it comes out like this:

8.4*(Yards passing + 11.9*Completions + 39.3*Touchdowns - 23.8*Interceptions)/(Number of attempts) = Passer Rating

If you think about it, this makes no sense at all.

Star-divide

It amounts to a measure of yards per attempt, which is a really nice core of a useful statistic, but then it adds some bonuses and penalties, which would be really nice features, if the bonuses and penalties made sense.  In this formula, you add a bonus of 11.9 yards for a completion and 39.3 yards for a touchdown pass, while penalizing a quarterback 23.8 yards for an interception.

Why reward the quarterback at all for merely completing a pass?  With this formula, it is actually better to complete a pass for a big loss than to throw it away.  

Illustration #1:  Quarterback #1 takes two consecutive throws.  The first is a screen pass on 1st and 10 that is stopped for -1 yards.  The second is a pass over the middle on 2nd and 11 to a tight end which goes for 6 yards.  Quarterback #2 takes two consecutive throws.  The first is a deep out that falls incomplete on 1st and 10.  On 2nd and 10, he hits the wideout on a 12-yard curl for a first down.  On those two throws, QB#1 has a passer rating of 120.96, while QB#2 has a passer rating of 100.38, but QB#2 has clearly helped his team a lot more.

Better still?  Take a sack, because it does not increase your number of attempts.

That brings up the second problem.  It does not account for a running quarterback.  It ignores the running and scrambling aspect entirely.  It makes the same mistake that football statisticians have always made: it does not include sacks and scrambles as part of the passing game.

Illustration #2:  Quarterback #1 drops back to pass twice.  The first time, the offensive line fails, and the rush gets to the quarterback.  He pulls down the ball and is sacked for a 5 yard loss, bringing up 3rd and 13.  On the second play, he completes a 10 yard pass, bringing up 4th and 3.  Quarterback #2 drops back to pass twice.  The first time, the offensive line fails and the rush gets to the quarterback.  He throws the ball away, bringing up 3rd and 8.  On the second play, he completes a 10 yard pass.  QB#1 has a passer rating of 183.96 while QB#2 has a passer rating of 91.98, but QB#2 has kept his offense on the field, while QB#1's team has had to punt.

The third problem here is that the bonus for a touchdown and the penalty for an interception are way out of balance.  If you add in the bonus merely for completing a pass, there is over a 50 yard bonus for completing a touchdown pass, while the penalty for an interception is less than half that.  This insufficiently penalizes interceptions relative to touchdown passes, and if you want an example of what that does to a passer rating, look at Jarrett Lee's stats from last year.  Despite his very high rate of interceptions, his passer rating was actually pretty darn good, one of the better passer ratings in the conference.

A few years ago, I developed my own.  Here is my formula:

Passer Rating = (yards passing + yards rushing - yards lost by sack + 5*(First down completions and runs) + 20*Number of Touchdowns - 30*Number of Turnovers)/(Number of pass attempts + rush attempts).

It's the same general idea.  It's based on a yards/attempt measure (but without that strange 8.4 multiplier that makes it difficult to understand), with bonuses and penalties.  There is no bonus merely for completing a pass.  There is a 5 yard bonus for getting your team a 1st down, a 20 yard bonus for getting your team a touchdown either by pass or run, a 30 yard penalty for throwing an interception or fumbling the ball away, and it includes rushing statistics.

With this formula, it is better to throw the ball away than to take a sack.  Better still is to scramble for a few yards.  It is significantly better to get 11 yards on 3rd and 10 than it is to get 9.  Having an equal number of touchdowns and interceptions is a bad thing with this rating, while before it was a good thing.

This, therefore, is actually very useful.  It includes more of the qualities that makes a quarterback good.  It gives sane bonuses to good results and sane penalties to bad results.  The traditional passer rating is so woefully inadequate and so easily correctible that I am amazed that those people who actually know what it is still use it on a regular basis.  

The ATVSQBPI is a stat that we will be keeping up with week-to-week as the season progresses.  In the past, I did not really have the ability to go in and see how many first downs a quarterback accounted for.  It's a statistic that is not kept (WHY!?) and you have to go into a play-by-play summary and actually physically count them.  It's not hard, but it's a little time-consuming.  Thanks to CCTV and RGI12, and anyone else who wants to chip in, we will get this done this year.

1 recs  |  Comment 14 comments |

Story-email Email Printer Print

More from And The Valley Shook

Behind the Numbers: LSU v UNC

Sep 2010 by Poseur - 8 comments

ATVSQBPI: Week 5

Oct 2009 by Richard Pittman - 5 comments

ATVSQBPI: Week 4

Sep 2009 by Richard Pittman - 0 comments

Comments

Display:

Yards/attempt

Stats geeks have known (or been pretty sure) for quite some time that the best quick and dirty measure of a quarterback is yards per attempt. It’s a great stat that puts QB’s who throw downfield and those who play in a west coast offense in fairly equal footing. People have been trying to modify that basic formula for the last 25 years to get a better measure. But it’s really the only logical place to start.

Pick up Pete Palmer’s Hidden Game of Football if you haven’t already.

Fake Pundit. Real Fan.
http://www.andthevalleyshook.com

by Poseur on Aug 14, 2009 7:32 AM CDT reply actions  

There is no perfect QB rating.

The reason they keep using the old formula, is because people can put it in perspective. We can’t do that with this formula.

My suggestion would be to take Pat White’s best year as a runner, and calculate his ATVSQBPI, then take his best year as a passer and calculate his ATVSQBPI. Also take Jevan Sneed’s year from last year, Jarrett Lee’s year from last year, and maybe like a Graham Harrell year, to give us some perspective on these rankings.

It will be interesting to follow though.

by LSU Jonno on Aug 14, 2009 8:10 AM CDT reply actions  

Passer rating

The biggest flaw of passer rating is that the scale is completely meaningless. To this day, I have no idea what is a decent passer rating. The scale makes no sense. I can wrap my mind around yards/attempt instantly. ATVSQBPI or any modified yds/att system makes sense for the same reason: it’s how many yards a QB is “worth” per play. The question is whether the metric accurately measures that worth.

Fake Pundit. Real Fan.
http://www.andthevalleyshook.com

by Poseur on Aug 14, 2009 8:39 AM CDT up reply actions  

If this works, you should get a job with Football Outsiders.

by Devin Grabarek on Aug 14, 2009 9:40 AM CDT reply actions  

Good thoughts

I decided to spend a minute seeing what the range of this stat would look like.

Plugging in the numbers: a qb that has a good game, going 20-31, 270 yards passing, 2 TDs, one INT, 3 rushes for -5 yards (say, two sacks and a scramble), with 8 first downs.

That’s (270 – 5) + 8(5) + 2(20) – 1(30)
          ————————————————
                        34

equals 9.26

A qb that has a horrible game, going 12-28 for 135 yards, losing 22 yards rushing on 3 attempts, throwing for 3 first downs, 1 TD and 3 INTS

(135 – 22) + 5(2) + 1(20) – 3(30)
-——————————————-
               31

equals 3.65

Now say someone has a ridiculous game: 25-30, 350 yards, rushing for 53 yards on 6 attempts, throwing for 13 first downs, 3 TDs and no INTS

(350 + 53) + 13(5) + 3(20) – 0(30)
________________________
              36

equals 14.67

Theoretically the highest one could get is 119 (perfect completion percentage, with all runs and passes going 99 yards for a TD).

This seems like a pretty good system to me — certainly better than the current QB rating system. Good score seem to be in the 8-10 range. Scores higher than that are really good.

Gregatron is not responsible for any of the crap he just wrote.
St. Louis vegetarian blog

by Gregatron on Aug 14, 2009 11:53 AM CDT reply actions  

When I've calculated it before, not using 1st downs..

7.0 was pretty close to the “decent” line.

Father. Husband. Lawyer. Nerd.

And The Valley Shook

by Richard Pittman on Aug 14, 2009 1:01 PM CDT up reply actions  

And there's the problem with this stat

It doesn’t “look” like much of a difference between 7 and 3.65. Which is why you get into these multipliers, to create more of a spread between good and bad scores.

The NFL’s system is scaled roughly like a grading system, where a 60 is a fail; 70 is low pass, etc and a 100 is a very good game. People are used to thinking that way. So this is all a roundabout way of saying maybe you should add a 10x multiplier to your score.

by 4.0 Point Stance on Aug 14, 2009 1:46 PM CDT up reply actions  

Since the stat is (and is designed to be) adjusted yards per attempt, what about actually referring to 7 yards per attempt, 3.65 yards per attempt, and so on?

3 Sep Ducks at Boise State
5 Sep Tigers at Washington
I smell road trip!

by AllSaintsDay on Aug 14, 2009 3:22 PM CDT up reply actions  

Or maybe 7 yards or 7 AYPA. Just something to indicate to the reader/viewer “Hey, when looking at this stat, think of it as YPA, with some tweaks”

3 Sep Ducks at Boise State
5 Sep Tigers at Washington
I smell road trip!

by AllSaintsDay on Aug 14, 2009 3:24 PM CDT up reply actions  

Right, but people are used to thinking about comparing running backs in that way. For quarterbacks they’re used to thinking on a passer rating scale roughly based around 100. I like All Saints’ idea of calling it something like Adjusted Yards Per Attempt to draw attention to that part of it

by 4.0 Point Stance on Aug 15, 2009 12:27 PM CDT reply actions  

The problem is that the college one is different..

It’s not at all uncommon to see pretty ordinary QBs with passer ratings around 130.

Father. Husband. Lawyer. Nerd.

And The Valley Shook

by Richard Pittman on Aug 15, 2009 12:56 PM CDT up reply actions  

Comments For This Post Are Closed


User Tools

Welcome to the SB Nation blog about LSU Tigers.
Start posting about the Tigers »

Join SB Nation and dive into communities focused on all your favorite teams.

Connect_with_facebook

FanPosts

Community blog posts and discussion.

Recommended FanPosts

Lsu_logo_small
Toonces Must DIE

Recent FanPosts

Jacobhester18_small
Next Time...
Thumbnail-halftime-speech-logo_small
LSU vs. UNC preview from Halftime Speech
Tiltekilt_satelite_tournament_003_small
Attention All LSU Tiger Fans Traveling to Atlanta
Small
What to expect in 2010 -- here's my take
Parents_weekend__sept
Alan Faneca Interview
Lsu_logo_small
LSU 2010 Football Fan Day
Patrickpetersonrainlsu_small
Good News, Everyone! Hebert Reinstated
Small
A Program On the Rebound
Tailgating_pics_046_small
10 Essential Needs for Every Tailgater

+ New FanPost All FanPosts >

Twitter: Coach Miles

follow Les on Twitter

Overall

1 - 0

Conference

0 - 0

Team Stats - Game Averages

Pts Yrds Pass Rush
Offense 0.8 313.0 151.0 162.0

SBNation.com Recent Stories

Boise State quarterback Kellen Moore (11) throws a deep pass in the first quarter against Louisiana Tech during their NCAA college football game in Ruston, La., Friday, Nov. 6, 2009. (AP Photo/Rogelio V. Solis) +1 updates

No. 3 Boise State And No. 10 Virginia Tech Provide Exciting Finish To Opening Weekend

ATLANTA - SEPTEMBER 4: Russell Shepard #10 of the LSU Tigers runs down the field for a touchdown against the North Carolina Tar Heels at the Georgia Dome September 4 2010 in Atlanta Georgia.  (Photo by Kevin C. Cox/Getty Images) +11 updates

LSU (Barely) Holds Off Depleted UNC, 30-24

Jacksonville State players celebrate their 49-48 double-overtime victory over Mississippi in an NCAA college football game in Oxford, Miss., Saturday, Sept. 4, 2010. (AP Photo/Rogelio V. Solis) +3 updates

Jacksonville State Pulls Major Upset, Stuns Ole Miss In Double Overtime

More from SBNation.com >


Managing Editor / Chief Lackey

Pb140006_small PodKATT

Editors

Gse_multipart30441_small Richard Pittman

Me_and_beer_small Poseur

Tower_small Billy Gomila

Paulcrewe_small Paul Crewe

Authors

Koolaid_small Jrlz