Thunderboomer's Blog
  • 10:07 PM ET  03.01
Views
188
Comments
10

Whew!  Finally got my first results:  I’ve put off doing some important things and finished the first round of “accomplishment point” calculations for all 122 Div-1A teams.  For the following calculations, all of the games for the season have been used for each team, including conference championships and bowl games.

Consider the following definitions for team X:

From the win-loss records of teams beaten:  100*W/(W+L) = TBP, where W and L are the sums of wins and losses from all teams beaten by team X
From the win-loss records of teams lost to:  W/(W+L) = TLR, where W and L are the sums of wins and losses from all teams that team X lost to
PTS1 = TBP*TLR

For team X, given its won-loss record, PTS2 = 100*w/(w+l)

A “bad loss” by team X is one where the opponent has a win-loss record below 0.500
A “quality win” by team X is one where the opponent has a win-loss record above 0.500
A “home loss” by team X is one where they lose at home
A “neutral win” by team X is one where they win at a neutral site
A “road win” by team X is one where they win at the opponent’s home field
A “non-FBS team” played by team X is any opponent that isn’t within NCAAF Division 1-A (FBS)

Accomplishment points begin with PTS3 = PTS1+PTS2

15 points are subtracted for each bad loss
5 points are added for each quality win
5 points are subtracted for each home loss
2 points are added for each win at a neutral site
5 points are added for each road win
5 points are subtracted for each non-FBS team played (win or lose)

Home wins and road losses both count for 0 points

For my Oklahoma Sooners,

Their season won-loss record is 12-2, so that PTS2 = 85.71
The teams they beat had a combined record of 82-71, so that TBP = 53.59
The teams to which they lost had a combined record of 25-2, so that TLR = 0.9259, which makes PTS1 = 49.62

PTS3= 85.71+49.62 = 135.34 (figures are shown rounded to 2 decimal places)

They had no bad losses
They had 7 quality wins = 35 points
They had no home losses
They had one win in 3 games played at neutral sites = 2 points
They had 5 road wins = 25 points
They played one non-FBS team (Chattanooga) = -5 points

This gives them a total of 192.34

The accomplishment points, ranked in order for all 122 Div. 1-A teams are (rounded to 3 decimal places:

Team    RD1 Points
Utah = 215.333
Florida = 197.822
Texas = 193.735
Oklahoma = 192.339
USC = 185.069
Alabama = 180.954
Boise State = 179.852
Texas Tech = 170.220
Cincinnati = 164.627
Georgia = 163.372
TCU = 158.827
Penn State = 157.624
Pittsburgh = 155.869
Ohio State = 152.788
Virginia Tech = 147.929
Ball State = 145.931
Oregon = 143.042
Michigan State = 139.629
Brigham Young = 139.087
Rice = 136.746
Missouri = 136.582
California = 128.566
Oregon State = 127.465
Boston College = 126.157
Oklahoma State = 124.103
Mississippi = 121.743
Florida State = 120.144
Nebraska = 120.039
Georgia Tech = 118.829
West Virginia = 114.726
Tulsa = 114.389
Iowa = 111.215
Western Michigan = 110.085
Kansas = 107.521
Air Force = 105.880
Rutgers = 104.811
Wake Forest = 104.742
Northwestern = 103.084
Miami (FL) = 103.015
Connecticut = 101.969
Fresno State = 101.563
North Carolina = 101.501
Louisiana State = 99.167
South Carolina = 97.776
North Carolina State = 97.195
Houston = 95.851
South Florida = 94.554
Louisiana Tech = 89.400
East Carolina = 89.162
Clemson = 89.047
Navy = 88.402
Nevada = 84.107
Maryland = 83.342
Troy = 82.350
Virginia = 81.081
Hawaii = 80.524
Buffalo = 80.516
Wisconsin = 79.236
Colorado State = 76.290
Central Michigan = 75.726
Arkansas = 69.405
Florida Atlantic = 67.673
Illinois = 65.854
Arizona = 65.634
Notre Dame = 65.214
Kentucky = 63.665
Vanderbilt = 62.367
Minnesota = 60.147
Colorado = 58.535
Duke = 52.015
Auburn = 51.931
Florida International = 49.764
Stanford = 49.596
UTEP = 48.172
Northern Illinois = 46.813
Arkansas State = 44.569
Temple = 44.103
Purdue = 39.968
Louisville = 37.987
Arizona State = 37.667
UNLV = 36.000
Bowling Green = 34.605
Southern Miss = 30.306
Marshall = 28.048
Akron = 27.370
Louisiana-Lafayette = 27.130
Tennessee = 23.827
Kansas State = 23.645
Middle Tennessee = 23.583
New Mexico = 21.575
UCLA = 21.190
Mississippi State = 20.246
Syracuse = 20.225
Baylor = 19.580
UCF = 17.333
Ohio = 16.794
San Jose State = 15.416
Memphis = 14.244
Utah State = 11.957
Wyoming = 11.253
Texas A&M = 6.920
Indiana = -0.749
Michigan = -3.544
Army = -14.835
Kent State = -16.461
Louisiana-Monroe = -18.862
San Diego State = -20.133
New Mexico State = -20.553
Idaho = -21.220
Toledo = -22.016
Western Kentucky = -33.941
Southern Methodist = -35.442
Washington State = -39.579
Eastern Michigan = -40.085
UAB = -40.861
North Texas = -47.609
Iowa State = -48.962
Tulane = -51.154
Miami (OH) = -64.396
Washington = -80.000

Average    69.205
Median    72.566

In the next stage of my project, the accomplishment points for the opponents during the year for all 122 teams will be entered and a first guess at “Strength of Schedule” (SoS) for team X will be the simple sum of the accomplishment points for its opponents.

Since I’m not actually calculating accomplishment points for non-FBS teams, any such in a given team’s schedule will be assigned accomplishment points as follows:

A W-L record over 0.500 = 0.00 accomplishment points for that team
A W-L record equal to 0.500 = -5.00 accomplishment points for that team
A W-L record under 0.500 = -10.00 accomplishment points for that team

When I get that done, I’ll use the SoS for each team to “adjust” its accomplishment points in a way to be specified later.  Then, I’ll use the adjusted accomplishment points to produce a revised SoS for each team, followed by another SoS adjustment of the accomplishment points for each team.  In principle, this could go on indefinitely – I’m stopping there.

Note that accomplishment points will not necessarily produce accurate predictions of the outcome of any actual game.  It measures the team accomplishments during the season and two iterations should result in a reasonably accurate measure of the SoS for each team.

Comment #1 has been removed
March 2, 2009  02:45 AM ET

Thanks for the input .. but my system just puts numbers on what I hope is based on common sense. As I hope is clear - most of Round 1 is based on simple W-L records. No "style points" and no point differentials are involved. Utah rates at the top because of their undefeated season. But ... their position might change in the next round. A hint of things to come: when you account for "SoS", things are gonna get pretty strange. This first round is straightforward, but if you're serious about adjusting for SoS, the rankings can get really interesting.

March 2, 2009  10:15 AM ET

I think the system is still subjective, and when you have Rice at #20, the "improved system" is suspect. I do not believe for a second Utah could contend with Florida or Texas, and I am sure that is an assumption shared by most AP sports writers.

March 2, 2009  01:18 PM ET

I'm interested to see what your future rounds will do, I think this is excellent work. "Putting numbers on common sense stuff" (paraphrasing - sorry) is not easy, and the old adage that common sense isn't common will rear it's head for certain down the road.

Good luck, will be watching to see what turns up.

March 2, 2009  05:40 PM ET
QUOTE(#3):

I think the system is still subjective, and when you have Rice at #20, the "improved system" is suspect. I do not believe for a second Utah could contend with Florida or Texas, and I am sure that is an assumption shared by most AP sports writers.

What do you think is "subjective" about my scheme? I think you may be using the term "subjective" incorrectly. The opposite of "subjective" is "objective" - i.e., based on fact, not opinion. My choices for how to combine terms and weight them are subjective, but once the choices are made, the calculations are objective. If you want different weighting, or a different combination, develop your own system and we can talk.

You're evidently misunderstanding what the 'accomplishment points' mean. Let me remind you of what I said at the end of post: "...accomplishment points will not necessarily produce accurate predictions of the outcome of any actual game."

Improved? Who made any claims about improvement and over what? I was curious to see what would happen and this is step one of a multi-step process. I'm NOT making any claims that this will be an infallible ranking system or a perfectly accurate predictor of game outcomes - any such interpretation of these results is simply a misinterpretation. It's based on a team's "body of work" during the 2008 CFB season.

I'm willing to entertain suggestions for changes and if time permits, I can explore what those changes might produce.

I couldn't care less about what AP sports writers think.

March 3, 2009  01:14 PM ET

Keep developing your system, TB, and keep posting the results. I find this type of analysis intriguing, especially since there is no way in Hades I could even attempt it.

March 3, 2009  05:06 PM ET
QUOTE(#4):

I'm interested to see what your future rounds will do, I think this is excellent work. "Putting numbers on common sense stuff" (paraphrasing - sorry) is not easy, and the old adage that common sense isn't common will rear it's head for certain down the road.Good luck, will be watching to see what turns up.

Thanks, GR. Indeed, "putting numbers on common sense" is a fair description of what the scheme does. Evidently, there's no way to keep folks from misinterpreting the results, which I expected, anyway. I've got a system pretty well worked out for calculating SoS for each team using: the sum of accomplishment points for its opponents (relative to the average accomplishment points for ALL teams) and the percentage of road games on its schedule (I noticed some wide variation in the number of road games amongst the Div 1-A teams and I wanted to boost a team's SoS if it had more road games.

I think my choice of variables conforms to "common sense" and although my weightings are mostly a WAG, I hope most people would find them at least plausible.

March 3, 2009  05:22 PM ET
QUOTE(#1):

Seems to me that your exhaustive study has shown that the current system is not quite the demon that we all make it to be. Perfect? By no means. I would still prefer a playoff, but outside of Utah and Texas, most of us could not argue with the results of the last year.

I should have responded to this earlier (I almost said "Sooner"!) ... I believe that the existing ranking system tries to do MORE than what I'm hoping to accomplish. The relatively good agreement between my Round-1 accomplishment points and the polls is explained by the significance of W-L records. My version of things will eventually result in accomplishment points based on the SoS, as well as the W-L record, but be prepared for some surprising things - my preliminaries suggest that - given the relative strength of the schedule - some teams are considerably better than their W-L record would suggest.

This shouldn't be used to infer that such teams are BETTER than others in a ranking sense, but rather indicates their positive accomplishments were achieved against a tough schedule, overall. I THINK this is what we hope to achieve with a scheme to estimate SoS.

A teaser in this vein - OU played a considerably tougher schedule (according to the Round-1 accomplishment points) than UTx, so the adjustment to their accomplishment points rates them ABOVE the 'horns. But then this implies that - since UTx won their head-to-head game - that victory is a bigger accomplishment than it might otherwise seem to be. So UTx's Round-2 SoS adjustment will need to be increased ...

I'm just following the numbers to see where they lead.

April 9, 2009  05:42 AM ET

The hard thing to quantify here is how deep into a season do you need to go to get enough valid data? My guess is about 8 games at least.

 
April 10, 2009  09:42 PM ET

A very good question. If I had nothing but spare time, it might be feasible to see how stable the results are with respect to the number of games played. Keep in mind that bowls and conference championships are typically against opponents of reasonable quality, whereas the opponent's strength during the regular season of 12 games is all over the map (but depends on what conference the team is in, of course).

Unfortunately, an analysis of the sensitivity of the results to the number of games played is well beyond my current capabilities. Unless I can write computer code to do all the analysis ... someday, maybe.

But what I'd like to see is how sensitive the results are to the various subjective choices I had to make in designing the scheme. Also beyond my present capabilities, sadly.

Comment

Remember to keep your posts clean. Profanity will get filtered, and offensive comments will be removed.


Coming soon: Log in with your Facebook account, send comments and Throwdowns to Facebook and more.

Start Your Own Blog

Start Now

The Si.com Cover Hub Go to the Cover Hub

Stub Hub

The 2009 schedule has been released. Search for tickets!

Truth & Rumors

MOST POPULAR

  1. 1
    Meeting with fans backfires on Browns owner
    Views
    28732
    Comments
    852
  2. 2
    Ex-Eagle: Cowboys everything wrong about NFL
    Views
    27788
    Comments
    583
  3. 3
    Canseco wants to fight A-Rod
    Views
    40165
    Comments
    207
  4. 4
    Mangini scaring off GM candidates?
    Views
    13001
    Comments
    147
  5. 5
    Gator Bowl eyeing Notre Dame
    Views
    3063
    Comments
    99

Throwdowns

Most Active Users

Comments + Blog Posts + Throwdowns

  1. 1
    Porkins: F U to Hell, BCS
  2. 2
    RobertMenn: You stole my rake
  3. 3
    Perfectpats
  4. 4
    sign here
  5. 5
    Oso: Yankees win again?

Message Boards

  1. NCAAF > General NCAAF

    CFB Game Day 11/7/2009
    Views
    396
    Replies
    120
  2. NCAAF > General NCAAF

    Sports Illustrated says Pac 10…
    Views
    280
    Replies
    70
  3. NCAAF > General NCAAF

    Iowa's loss was good for the…
    Views
    216
    Replies
    44

Blogs