| 1. | rdore | Richard Dore |
|---|---|---|
| 2. | zanderso | Zach Anderson, Harold Hsiung |
| 3. | nck | Nathan Keim |
| 4. | osoong | Oliver Soong |
| 5. | smarx | Steve Marx |
| 6. | mim | Mike Mandel |
| 7. | seltzer2 | Andrew Chi, Michelle Kinder, Mike Seltzer |
| 8. | and_lose_to | Shawn Badlani, Brian O'Kelly |
| 9. | Grrr | Jeremy Davidson, Andrew Grier, Eric Wang |
| 10. | Heron | Ali Huff, Harini Raghupathi, Erin Tyndall |
| 11. | stupid | Colin Dawson, Pat Moeller, Joy Tsai |
| 12. | pal | Laura Babcock, Pius Uzamere, Ali Yurkovic |
| 12. | happy_dance | Helen Curry, Jess Reynolds, Anne Warner |
| 14. | Rosswell | Ross Burton |
| 15. | krunch | Onny Chatterjee, Zach Firth, Saurabh Sanghvi |
| 16. | HeyBaby | Ruth Carlitz, Susie James, Bronwyn Uber |
| 16. | AC | Tony D'Amelio, Christine Edmonds |
And now, to explain the method...
Before qualifying teams, I first fixed all the programs so that they did not incur errors.
To qualify teams, I played each of the 39 entries against Spot 100 times. A team received a point when they beat Spot and half a point when they tied. The scores leveled out at 29 points; any team scoring above 30 points, therefore, qualifies for the finals.
In my experience, some players who do very poorly with this test still do very well against other (non-random) players. Thus I draw the line fairly low. This has the disadvantage of qualifying a couple of teams that really have a strategy solidly in Level 1, but I don't make that judgement for the tournament.
Results from the qualifiers:
| W/L/T | score | team | members |
|---|---|---|---|
| 81/ 8/11 | 86.5 | nck | Nathan Keim |
| 60/28/12 | 66.0 | zanderso | Zach Anderson, Harold Hsiung |
| 55/32/13 | 62.5 | and_lose_to | Shawn Badlani, Brian O'Kelly |
| 56/33/11 | 61.5 | osoong | Oliver Soong |
| 54/32/14 | 61.0 | rdore | Richard Dore |
| 49/33/18 | 58.0 | mim | Mike Mandel |
| 47/41/12 | 53.0 | Grrr | Jeremy Davidson, Andrew Grier, Eric Wang |
| 40/47/13 | 46.5 | Rosswell | Ross Burton |
| 36/45/19 | 45.5 | seltzer2 | Andrew Chi, Michelle Kinder, Mike Seltzer |
| 32/58/10 | 37.0 | Heron | Ali Huff, Harini Raghupathi, Erin Tyndall |
| 30/63/ 7 | 33.5 | happy_dance | Helen Curry, Jess Reynolds, Anne Warner |
| 29/65/ 6 | 33.0 | HeyBaby | Ruth Carlitz, Susie James, Bronwyn Uber |
| 29/65/ 6 | 33.0 | stupid | Colin Dawson, Pat Moeller, Joy Tsai |
| 28/65/ 7 | 31.5 | pal | Laura Babcock, Pius Uzamere, Ali Yurkovic |
| 25/62/13 | 31.5 | krunch | Onny Chatterjee, Zach Firth, Saurabh Sanghvi |
| 25/64/11 | 30.5 | AC | Tony D'Amelio, Christine Edmonds |
To get the final results, each player played each other 200 times. Then I look closely at the results and try to find an ordering that makes sense. From there I had the top six players play each other another 2000 times. Where the results were close, I added another 3000 games to make sure of the numbers. The top two, since they were quite close, played each other another 5000 times, for a total of more than 10200 games.
From there, I ranked the players carefully. This requires some eyeball judgement, since players do not always fall neatly into a linear ranking. My judgements in this arena are final.
The following table reports the results. The percentage of points won by a player has been multiplied by 2000, so that for each pair, the player winning at least half the points has a four-digit score, and players winning less has a three-digit score.
| rdo | zan | nck | oso | sma | ali | bob | mim | sel | and | Grr | Her | stu | pal | hap | Ros | kru | Hey | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| rdore | 1018 | 1072 | 1058 | 1066 | 1035 | 1180 | 1078 | 1210 | 1150 | 1380 | 1385 | 1335 | 1080 | 1115 | 1220 | 1205 | 1260 | |
| zanderso | 982 | 1443 | 979 | 1125 | 1110 | 1155 | 1102 | 1195 | 1290 | 1185 | 1505 | 1455 | 1755 | 1645 | 1300 | 1345 | 1710 | |
| nck | 928 | 557 | 1074 | 1168 | 1030 | 1185 | 1184 | 1430 | 1415 | 1450 | 1695 | 1680 | 1735 | 1710 | 1100 | 1405 | 1740 | |
| osoong | 942 | 1021 | 926 | 974 | 1004 | 1130 | 1184 | 1160 | 1175 | 1130 | 1175 | 1395 | 1420 | 1485 | 1145 | 1170 | 1605 | |
| smarx | 934 | 875 | 832 | 1026 | 1050 | 1220 | 1185 | 1385 | 1470 | 1500 | 1675 | 1615 | 1690 | 1735 | 1005 | 1180 | 1680 | |
| alice | 965 | 890 | 970 | 996 | 950 | 1255 | 1215 | 1470 | 1480 | 1510 | 1625 | 1765 | 1745 | 1750 | 1015 | 1145 | 1700 | |
| bob | 820 | 845 | 815 | 870 | 780 | 745 | 1200 | 1300 | 1300 | 1360 | 1625 | 1700 | 1770 | 1705 | 1155 | 1300 | 1825 | |
| mim | 922 | 898 | 816 | 816 | 815 | 785 | 800 | 1110 | 1130 | 1095 | 1235 | 1460 | 1455 | 1530 | 1185 | 1190 | 1400 | |
| seltzer2 | 790 | 805 | 570 | 840 | 615 | 530 | 700 | 890 | 1050 | 1155 | 1350 | 1340 | 1505 | 1645 | 1050 | 1215 | 1410 | |
| and_lose_to | 850 | 710 | 585 | 825 | 530 | 520 | 700 | 870 | 950 | 1195 | 1350 | 1365 | 1535 | 1590 | 1070 | 1250 | 1510 | |
| Grrr | 620 | 815 | 550 | 870 | 500 | 490 | 640 | 905 | 845 | 805 | 1270 | 1450 | 1385 | 1540 | 985 | 1190 | 1530 | |
| Heron | 615 | 495 | 305 | 825 | 325 | 375 | 375 | 765 | 650 | 650 | 730 | 1170 | 1165 | 1315 | 1010 | 1035 | 1200 | |
| stupid | 665 | 545 | 320 | 605 | 385 | 235 | 300 | 540 | 660 | 635 | 550 | 830 | 1165 | 1130 | 1100 | 1090 | 1195 | |
| pal | 920 | 245 | 265 | 580 | 310 | 255 | 230 | 545 | 495 | 465 | 615 | 835 | 835 | 1005 | 1240 | 1040 | 1185 | |
| happy_dance | 885 | 355 | 290 | 515 | 265 | 250 | 295 | 470 | 355 | 410 | 460 | 685 | 870 | 995 | 1140 | 1095 | 1015 | |
| Rosswell | 780 | 700 | 900 | 855 | 995 | 985 | 845 | 815 | 950 | 930 | 1015 | 990 | 900 | 760 | 860 | 910 | 1010 | |
| krunch | 795 | 655 | 595 | 830 | 820 | 855 | 700 | 810 | 785 | 750 | 810 | 965 | 910 | 960 | 905 | 1090 | 945 | |
| HeyBaby | 740 | 290 | 260 | 395 | 320 | 300 | 175 | 600 | 590 | 490 | 470 | 800 | 805 | 815 | 985 | 990 | 1055 |