HSEval Rankings
The solutions of the archive, with the solution groups sorted by increasing average rank, as defined by the rules of the Third International Timetabling Competition. A detailed explanation appears after the table.
Solution group rankings
Trial | GOAL | HySST | Lectio | HFT | VAGOS | ||||||
Instance | RandSeed | Cost | Rank | Cost | Rank | Cost | Rank | Cost | Rank | Cost | Rank |
BrazilInstance2 | none | 0.00032 | EXCLUDED | 0.00044 | 3.0 | 0.00005 | 1.0 | 0.00082 | 4.0 | 0.00026 | 2.0 |
BrazilInstance3 | none | 0.00101 | EXCLUDED | 0.00084 | 3.0 | 0.00048 | 2.0 | 0.00212 | 4.0 | 0.00047 | 1.0 |
BrazilInstance4 | none | 1.00136 | EXCLUDED | 0.00176 | 3.0 | 0.00090 | 2.0 | 0.00205 | 4.0 | 0.00078 | 1.0 |
BrazilInstance6 | none | 0.00160 | EXCLUDED | 0.00150 | 3.0 | 0.00060 | 1.0 | 0.00347 | 4.0 | 0.00074 | 2.0 |
FinlandElementarySchool | none | 0.00003 | 2.5 | 0.00003 | 2.5 | 0.00003 | 2.5 | 0.00003 | 2.5 | ABSENT | 5.0 |
FinlandSecondarySchool2 | none | 0.00000 | 2.0 | 0.00000 | 2.0 | 0.00000 | 2.0 | 0.00576 | 4.0 | ABSENT | 5.0 |
Aigio 1st High School 2010-2011 | none | 0.00000 | 1.0 | 0.00218 | 3.0 | 0.00076 | 2.0 | 0.00555 | 4.0 | ABSENT | 5.0 |
Italy_Instance4 | none | 0.00061 | 2.0 | 0.00052 | 1.0 | 0.00078 | 3.0 | 0.08623 | 4.0 | ABSENT | 5.0 |
KosovaInstance1 | none | 0.00003 | 1.0 | 0.01721 | 2.0 | 274.00281 | 4.0 | 36.12987 | 3.0 | ABSENT | 5.0 |
Kottenpark2003 | none | 0.05355 | 3.0 | 0.03919 | 2.0 | 0.02918 | 1.0 | 1.88983 | 4.0 | ABSENT | 5.0 |
Kottenpark2005A | none | 24.13930 | 2.0 | 15.28693 | 1.0 | 198.04845 | 4.0 | 36.36132 | 3.0 | ABSENT | 5.0 |
Kottenpark2008 | none | 10.27909 | 1.0 | 16.17720 | 2.0 | 129.69216 | 3.0 | 167.99999 | 4.0 | ABSENT | 5.0 |
Kottenpark2009 | none | 19.05590 | 2.0 | 18.08010 | 1.0 | 87.09440 | 3.0 | 148.99999 | 4.0 | ABSENT | 5.0 |
Woodlands2009 | none | 0.00012 | 1.0 | 0.00013 | 2.0 | 0.00019 | 3.0 | 8.00206 | 4.0 | ABSENT | 5.0 |
Spanish school | none | 0.00441 | 1.0 | 0.00920 | 3.0 | 0.00762 | 2.0 | 1.08163 | 4.0 | ABSENT | 5.0 |
WesternGreeceUniversityInstance3 | none | 0.00005 | 1.5 | 0.00007 | 3.0 | 30.00002 | 5.0 | 0.00032 | 4.0 | 0.00005 | 1.5 |
WesternGreeceUniversityInstance4 | none | 0.00008 | 1.0 | 0.00009 | 2.0 | 35.00058 | 4.0 | 0.00142 | 3.0 | ABSENT | 5.0 |
WesternGreeceUniversityInstance5 | none | 0.00000 | 2.0 | 0.00000 | 2.0 | 4.00001 | 5.0 | 0.00064 | 4.0 | 0.00000 | 2.0 |
Sum of ranks | 23.0 | 40.5 | 49.5 | 67.5 | 69.5 | ||||||
Number of ranks | 14 | 18 | 18 | 18 | 18 | ||||||
Average rank | 1.64 | 2.25 | 2.75 | 3.75 | 3.86 |
The solution groups appear from left to right in order of increasing average rank as defined by the rules of the Third International Timetabling Competition. Each row represents one trial: one instance plus one random seed. Under each solution group is the result of that trial in that solution group: a cost plus the rank of that cost within the row. If the solution group contains no solution for that trial, or the solution is invalid, the cost is ABSENT or INVALID and the rank is maximal; if it contains two or more solutions the cost is DUPLICATE and the rank is maximal. If the solution is required to be excluded, its cost is given but its rank is EXCLUDED. The last three rows contain, for each solution group, the sum of its ranks, the number of ranks, and the quotient of those quantities.
HSEval Software Copyright Jeffrey H. Kingston 2012