For a real explanation, visit Massey's FAQ and Theory pages.
One of the more interesting aspects of his ratings website is perhaps the predictions that his ratings allow. For instance, we see that Calvin is projected to have only a 16% chance of beating Whitworth tomorrow, and that the 'most likely' score is 78-68 in favor of the Pirates. That's cool and all, but what I'm going to look at are his retro-active predictions for the Knights.
As the season goes on and more data points are added to the system, the ratings for each team are adjusted, and so are the predictions for the games that have already happened. For instance, just before Calvin and Finlandia met on the eve of Thanksgiving, Massey said that Calvin was expected to win by 25 points. Now, a month later, the prediction page says that Calvin should win by 14.
I went back through the nine games that the Knights have played to see how the actual score lines up with the current "retro" prediction:
|Date||Opponent||Home/Away||Exp. Margin||Act. Margin||Overperform/Underperform|
|Nov 15||Anderson||Away||-4||-13||Underperformed by 9 points|
|Nov 18||Grace Bible||Home||1||4||Overperformed by 3 points|
|Nov 19||Willamette||Home||9||5||Underperformed by 4 points|
|Nov 23||Finlandia||Home||14||8||Underperformed by 6 points|
|Nov 25||Cornerstone||Away||-10||-17||Underperformed by 7 points|
|Nov 26||Aquinas||Neutral||-6||-6||As Expected|
|Dec 2||Carthage||Home||-2||3||Overperformed by 5 points|
|Dec 13||Wheaton||Home||-9||-5||Overperformed by 4 points|
|Dec 10||Trinity Christian||Home||12||20||Overperformed by 8 points|
As you can see, the Knights have out-performed their projection four times, hit it exactly once, and underperformed four times. The encouraging news is that the underperformances came early, while the overperformances have mostly been in the recent games*.
*Note that the only early-season overperformance was versus Grace, a game that they "should have lost" twice and needed two overtimes to finally win.
Here's a line graphs that shows us mostly the same thing as the chart above.
In the first five games, they performed (on average) 4.6 points worse than their current rating predicts. In their last four games, they've performed 4.3 points better than their rating predicts. Compare this graph to Hope's graph, which shows some 'first half' to 'second half' (of the season to date) improvement (with respect to current Massey rating, not with respect to beginning or current team talent level), but in a much less obvious fashion than Calvin's does.
I'm hoping this is a sign that our young Calvin Knights are indeed getting better as they gain experience, and that the team they'll be next month is vastly different than the team they are right now, or that they were a month ago.
Want to stay up to date on the happenings at FFTMAG? Follow me on Twitter, “like” us on Facebook, and grab our RSS Feed. Need a ride to a game? Check out the Ride Board and post your needs.