Round 3

HSEval Rankings HSEval Version 1.23 (June 2012)

HSEval Rankings

The solutions of the archive, with the solution groups sorted by increasing average rank, as defined by the rules of the Third International Timetabling Competition. A detailed explanation appears after the table.

Solution group rankings

Trial GOAL HySST Lectio HFT VAGOS
Instance RandSeed Cost Rank Cost Rank Cost Rank Cost Rank Cost Rank
BrazilInstance2 none 0.00032 EXCLUDED 0.00044 3.0 0.00005 1.0 0.00082 4.0 0.00026 2.0
BrazilInstance3 none 0.00101 EXCLUDED 0.00084 3.0 0.00048 2.0 0.00212 4.0 0.00047 1.0
BrazilInstance4 none 1.00136 EXCLUDED 0.00176 3.0 0.00090 2.0 0.00205 4.0 0.00078 1.0
BrazilInstance6 none 0.00160 EXCLUDED 0.00150 3.0 0.00060 1.0 0.00347 4.0 0.00074 2.0
FinlandElementarySchool none 0.00003 2.5 0.00003 2.5 0.00003 2.5 0.00003 2.5 ABSENT 5.0
FinlandSecondarySchool2 none 0.00000 2.0 0.00000 2.0 0.00000 2.0 0.00576 4.0 ABSENT 5.0
Aigio 1st High School 2010-2011 none 0.00000 1.0 0.00218 3.0 0.00076 2.0 0.00555 4.0 ABSENT 5.0
Italy_Instance4 none 0.00061 2.0 0.00052 1.0 0.00078 3.0 0.08623 4.0 ABSENT 5.0
KosovaInstance1 none 0.00003 1.0 0.01721 2.0 274.00281 4.0 36.12987 3.0 ABSENT 5.0
Kottenpark2003 none 0.05355 3.0 0.03919 2.0 0.02918 1.0 1.88983 4.0 ABSENT 5.0
Kottenpark2005A none 24.13930 2.0 15.28693 1.0 198.04845 4.0 36.36132 3.0 ABSENT 5.0
Kottenpark2008 none 10.27909 1.0 16.17720 2.0 129.69216 3.0 167.99999 4.0 ABSENT 5.0
Kottenpark2009 none 19.05590 2.0 18.08010 1.0 87.09440 3.0 148.99999 4.0 ABSENT 5.0
Woodlands2009 none 0.00012 1.0 0.00013 2.0 0.00019 3.0 8.00206 4.0 ABSENT 5.0
Spanish school none 0.00441 1.0 0.00920 3.0 0.00762 2.0 1.08163 4.0 ABSENT 5.0
WesternGreeceUniversityInstance3 none 0.00005 1.5 0.00007 3.0 30.00002 5.0 0.00032 4.0 0.00005 1.5
WesternGreeceUniversityInstance4 none 0.00008 1.0 0.00009 2.0 35.00058 4.0 0.00142 3.0 ABSENT 5.0
WesternGreeceUniversityInstance5 none 0.00000 2.0 0.00000 2.0 4.00001 5.0 0.00064 4.0 0.00000 2.0
Sum of ranks   23.0   40.5   49.5   67.5   69.5
Number of ranks   14   18   18   18   18
Average rank   1.64   2.25   2.75   3.75   3.86

The solution groups appear from left to right in order of increasing average rank as defined by the rules of the Third International Timetabling Competition. Each row represents one trial: one instance plus one random seed. Under each solution group is the result of that trial in that solution group: a cost plus the rank of that cost within the row. If the solution group contains no solution for that trial, or the solution is invalid, the cost is ABSENT or INVALID and the rank is maximal; if it contains two or more solutions the cost is DUPLICATE and the rank is maximal. If the solution is required to be excluded, its cost is given but its rank is EXCLUDED. The last three rows contain, for each solution group, the sum of its ranks, the number of ranks, and the quotient of those quantities.


HSEval Software Copyright Jeffrey H. Kingston 2012