Note: This post was originally published at College Basketball Reference, S-R's brand-new College Hoops site, so when you're done reading, go over and check it out!

In a variation on a running theme (one that's especially pertinent given the early departures of Syracuse, Kansas, & Kentucky from this year's tourney), I wanted to know how often the "best" (i.e., most talented, most dominant over the entire season, etc.) team wins the NCAA Tournament. We know that the NFL's best team wins the Super Bowl about 24% of the time, that the best team in baseball wins the World Series about 29% of the team (or at least, they did back in the 1980s when Bill James studied the issue), and that the NBA's best team wins the Finals almost half of the time... So what's your guess for college basketball?

On the one hand, the NCAA tourney seems to have more in common with football, since it's a string of single-elimination games (made even more random by the games being played at neutral sites); however, on the other hand it's still basketball, and the structure of the game itself is set up such that the better team wins more often than in other sports (in no small part due to the massive number of possessions per game -- unlike football -- as well as the ability to have your best player carry a disproportionate share of the team's offensive chances -- unlike baseball).

But rather than just make a guess, I once again set up a Monte Carlo simulator and ran a series of "test seasons". To do this, I used the 2009-10 D-I basketball schedule, excluding postseason & conference tournament games, as well as games involving non-D-I schools. For each school, I assigned them a random "strength rating" from a normal distribution based on the average SRS scores of their conference members since 1980:

So for instance, you might end up with an ACC that looks like this:

...And a Patriot League that looks like this:

Do this for every team in the country, and estimate the chances of one team beating another at home using this equation:

p(homeWin) = 1 / (1 + EXP(-0.7390072 - 0.179593 * SRSdiff))

(Note: For neutral games, I averaged p(homeWin) and p(roadWin) in a given matchup.)

From this, you can generate standings for the 2010 regular season, like these:

You can also use these simulated W-L results to calculate RPI, the Ratings Percentage Index that the selection committee uses to inform their picks. The formula is 25% team winning pct., 50% opponents' winning pct., and 25% opponents' opponents' winning pct:

Now we have all the components in place to put together the field for a simulated NCAA Tournament. The selections go like this: the 32 conference regular-season champions get automatic bids (ties are broken by RPI); the remaining 32 at-large slots are filled by the 32 best non-conference champs by RPI. Overall seedings are then made, ranking all tourney selections by RPI, and the regions are seeded according to an S-curve.

As you can see, I tracked the global "talent ranking" of the eventual champion for each simulated season; in this case, it was Kentucky, who ranked 9th in team talent (in case you're wondering, NC State was #1, but they were toppled by Arkansas in the Round of 32). Repeat this process 1,000 times, and how often does a team of each talent ranking win it all?

The nation's most talented team wins the National Championship approximately one-third of the time in this simulation, which is slightly higher than we observed for football and baseball, but much lower than the results of a similar simulation of NBA results. Going back to our original hypotheses, it was clear that a single-elimination tournament of 6 rounds creates many opportunities for favored teams to slip up along the way to a title, in much the same way that the NFL playoffs' one-and-done format encourages parity. At the same time, though, the better team wins a basketball game more often than it wins a football or baseball game simply because the random variance of luck is reduced with higher-scoring games and more possessions.

In the end, we saw basically what we should have predicted before the experiment -- by mixing high-variance elements of other playoffs, including a single-elimination format, the NCAA Tournament will never see the best team prevail as often as we see in the NBA Playoffs, but the nature of basketball offsets these elements to a certain degree, resulting in a winning percentage for the best team that falls between those of the NBA and the NFL/MLB.

And a less abstract take-home message? Well, when the 2010 NCAA champs are crowned on Monday night, they'll be the most deserving team, having outlasted 64 others over the past few weeks... But will they be the nation's best college basketball team? The odds have spoken -- and they say probably not.

This entry was posted on Wednesday, March 31st, 2010 at 2:31 am and is filed under NCAA, SRS, Statgeekery. You can follow any responses to this entry through the RSS 2.0 feed. Both comments and pings are currently closed.