And The Valley Shook: An SB Nation Community

Navigation: Jump to content areas:


Pro Quality. Fan Perspective.
Login-facebook
New Blog: The Nova Blog for Villanova Fans!

Why I Think Pre-Season Polls are Destructive

As Purple Reign pointed out, LSU was ranked #6 in the first important pre-season ranking of the season.  The ESPN/USAToday coaches' poll.  Purple Reign goes on to say, "Okay, it's the preseason, so it really doesn't mean anything (unless it's 2004 and you're Auburn)."

But there's the problem.  It sometimes really does mean something.  In fact, sometimes the pre-season polls actually are determinative of something important that happens later in the season, and the 2004 Auburn squad provides the perfect example of a team that that lost a significant opportunity for the sole reason that no one realized before the season that they would actually be really really good.

How did it hurt Auburn?  Well, in the pre-season rankings, Southern Cal and Oklahoma were #1 and #2.  Auburn was down in the teens.  All three of those teams went undefeated, but teams so rarely moved down the polls unless they lost.  Because Southern Cal and Oklahoma never lost, Auburn never had a shot at breaking into the top 2, no matter what they did.  And all they did was run the table in the SEC, a feat that was not respected as much as it should have been because they, "had a few close games" rather than blowing everybody out.

Now, what's so bad about that?  Well, I have a theoretical problem with pre-season rankings (and early-season rankings for that matter).  I think I said it best in a post back at GeauxTuscaloosa:

First, let's go into (again) why I don't like preseason rankings in general. I've discussed it before, and the criticisms are mostly obvious, but I want to go into one that isn't obvious.

Late-season polls and rankings are (or should be at least) measurements of how good your season is, compared to other teams. Late season polls are based on performance, then. All the talent in the world won't get you in the top 10 if you finish the season 5-8. 

On the contrary, preseason and early-season polls and rankings cannot be based on performance, because there is no performance to gauge. They have to be based on something else. But what exactly? 

In my opinion, preseason polls and rankings, if you're going to have them at all, should be based on perceived ability. This means that you look at the talent on the team and the coaching and try to decide who is better than whom. Frankly, I think it's an impossible task to get right, and it's plainly laughable to make a serious effort at it when you don't know which key players on the teams will be leaving early for the NFL.

The problem is that I don't think many polls or rankings in preseason or early in the season are based on perceived ability. I think they're based more on expected performance. These are two different things, and I'll illustrate to you what makes them different. If you are evaluating perceived ability, I think the easiest way to visualize this is to imagine two teams playing on a neutral site, and imagining who would likely win. If you are evaluating expected performance, you look at the team's schedule and decide how they will perform against that schedule, compared to other teams will perform against their own schedule.

If you're using expected performance, you aren't ranking ability before the season. You're predicting the end result after the season. I believe it is illegitimate to do so, since the biggest and most commonly referenced rankings are actually used as a starting point for future rankings. In other words, they predict performance and then the predictions actually have an impact on how performance is gauged. Schlabach is doing exactly this kind of prediction, as are most people. How do I know? Every one of his brief team profiles contains at least one sentence evaluating the difficulty of the team's schedule. If you were simply using perceived ability to evaluate the team, there would be no reason to even consider the team's schedule.

I was reacting to an absurdly early pre-season ranking put together by ESPN's Mark Schlabach.  His ranking, like so many others, aren't really attempting to rank the quality of a team, but are incorporating at least some element of predicted performance.  The cockles of my heart find this deeply troubling.

I think it's part of the Culture of Prediction that I rebel against.  Various members of the media and the public think you aren't doing your job as an analyst if you don't at least try to predict who will win the game, the conference, the national championship, or certain post-season awards.  It is as if many people believe that if you understand the game of football, it means you should be able to predict its outcome.

I disagree very strongly with that notion, and in fact I think just the opposite.  I think probably the single biggest football-related epiphany I ever had was when I realized that the game of football was eminently unpredictable.  When I didn't understand football all that well, I thought I could handicap.  The more I learned, the more closely I studied, the more I realized that the elements of randomization inherent in the game of football made prediction very unreliable.

Sure, when a really good team plays a really bad team, you can predict the really good team will win 100% of the time, and you'll be right approximately 99% of the time.  But when two evenly matched teams play, the game is almost always decided by little things.  A penalty here.  A missed tackle there.  A fumble that could have been recovered by one team but was instead recovered by the other.  Most games are decided by a couple of key plays.  You would be a fool to think you could reliably predict the outcome when two similarly skilled teams play one another.

Even the LSU-Ohio State game, which was not particularly close, would have been very different if just a couple of plays had gone differently.  If Ricky Jean-Francois doesn't block that kick (and assuming the kick was on target), and if the Ohio State player doesn't rough our punter early in the 3rd, the game would have been very different.  If Harry Coleman doesn't recover Chad Jones' fumble, the game would have been very different.  

You can't possibly predict those things.  You can't predict which of those events will happen, or how they will impact the game, and only the most lopsided matchups aren't profoundly impacted by those sorts of plays.

This is why I think rankings should only come out starting about halfway through the season, and they should only measure actual accomplishments on the field.  Nothing else.  Even if you use "perceived ability" rather than "expected performance" as your gauge, you eventually have to transition between that and measuring past performance, and that is a tricky thing to do, in my opinion.

So, SAY NO TO PRE-SEASON RANKINGS!

0 recs  |  Comment 0 comments

Story-email Email Printer Print

Comments

Display:

Comments For This Post Are Closed


User Tools

Welcome to the SB Nation blog about LSU Tigers.
Start posting about the Tigers »

Join SB Nation and dive into communities focused on all your favorite teams.

Connect_with_facebook

FanPosts

Community blog posts and discussion.

Recent FanPosts

Pb140006_small
RUMOR: Ensminger for TE/QB coach
Small
Who gets #18?  Murphy.
Small
2010 Recruiting class Highlight Video
Small
I was heading to NOLA for Mardi Gras when...
Small
2010 LSU Basketball Recruiting Class - Andre Stringer
Fiddler_on_the_roof_fiddler_1__small
From RockyTopTalk.com-Tennessee reportedly loses J.C. Copeland to LSU
Small
If you could bring back one Tiger from the 2000's for next year's team, who would it be?
Alabama_logo2_small
Really ESPN?
Got_les_small
NSD Notice to LSU Recruits: This Is the Real Les Miles!
Small
GIANT slap in the face ESPN

+ New FanPost All FanPosts >

Twitter: Coach Mainieri

follow CPM on Twitter

SBNation.com Recent Stories

The offensive line is reflected in the visor of Wisconsin running back John Clay during the second half of an NCAA football game against Michigan, Saturday, Nov. 14, 2009, in Madison, Wis. (AP Photo/Morry Gash) link

Wisconsin RB John Clay Will Miss Entire Spring Season

South Florida's Mike Ford carries the ball against Northern Illinois University Huskies during the International Bowl NCAA college football game in Toronto on Saturday, Jan. 2, 2010. Ford ran for a career-high 207 yards and scored one touchdown in their 27-3 win. (AP Photo/The Canadian Press, Chris Young) link

USF Dismisses RB Mike Ford

In this photo made Oct. 3, 2009, Notre Dame wide receiver Golden Tate celebrates a fourth quarter touchdown against Washington in an NCAA college football game in South Bend, Ind. Notre Dame defeated Washington 37-30 in overtime. Tate struggled last season when Michael Floyd was injured but this season has looked comfortable just about anywhere on the field where he can get hands on the football. (AP Photo/Michael Conroy)

NFL Draft 2010 Player Profile: Golden Tate, Notre Dame Wide Receiver

More from SBNation.com >


Managers

Pb140006_small PodKATT

Editors

Gse_multipart30441_small Richard Pittman

Me_and_beer_small Poseur

Lsu_logo_small Purple Reign

Photo_small Dane Noble

Authors

Dduzcaz8lg8xca1e9umxcayb6h89casec7jycanko951caqq3246cavdxhrccam82axacat2kr9qca2oz3rsca64takzcaw0toprca4hx60mcahrmqq0cad7ixvgcayr1dn9cahuxjuicaeieutgca3t3udbcaeieq7pca2s0zi6_small Tortfeasor

Koolaid_small Jrlz

Official Partner of CBS Sports