Round 2

HSEval Rankings HSEval Version 1.23 (June 2012)

HSEval Rankings

The solutions of the archive, with the solution groups sorted by increasing average rank, as defined by the rules of the Third International Timetabling Competition. A detailed explanation appears after the table.

Solution group rankings

Trial GOAL HySST Lectio HFT
Instance RandSeed Cost Rank Cost Rank Cost Rank Cost Rank
BrazilInstance2 102545520 1.00063 EXCLUDED 1.00078 2.0 0.00046 1.0 7.00189 3.0
BrazilInstance2 109328591 1.00054 EXCLUDED 1.00075 2.0 0.00057 1.0 5.00183 3.0
BrazilInstance2 234546972 1.00087 EXCLUDED 1.00081 2.0 0.00028 1.0 7.00180 3.0
BrazilInstance2 317604170 1.00051 EXCLUDED 1.00078 2.0 0.00019 1.0 6.00186 3.0
BrazilInstance2 584363925 1.00054 EXCLUDED 1.00069 2.0 0.00047 1.0 5.00198 3.0
BrazilInstance2 65843198 1.00063 EXCLUDED 1.00082 2.0 0.00038 1.0 6.00207 3.0
BrazilInstance2 792992094 1.00063 EXCLUDED 1.00087 2.0 0.00025 1.0 7.00195 3.0
BrazilInstance2 802033156 1.00066 EXCLUDED 1.00072 2.0 0.00034 1.0 6.00165 3.0
BrazilInstance2 856676505 1.00066 EXCLUDED 1.00072 2.0 0.00034 1.0 7.00210 3.0
BrazilInstance2 96247109 1.00051 EXCLUDED 1.00078 2.0 0.00053 1.0 7.00189 3.0
BrazilInstance3 102545520 0.00132 EXCLUDED 0.00096 1.0 0.00159 2.0 29.00264 3.0
BrazilInstance3 109328591 0.00134 EXCLUDED 0.00126 1.0 0.00175 2.0 31.00288 3.0
BrazilInstance3 234546972 0.00138 EXCLUDED 0.00123 1.0 0.00153 2.0 28.00285 3.0
BrazilInstance3 317604170 0.00087 EXCLUDED 0.00111 1.0 0.00112 2.0 30.00306 3.0
BrazilInstance3 584363925 0.00117 EXCLUDED 0.00096 1.0 0.00150 2.0 26.00264 3.0
BrazilInstance3 65843198 0.00135 EXCLUDED 0.00123 1.0 0.00171 2.0 32.00276 3.0
BrazilInstance3 792992094 0.00129 EXCLUDED 0.00132 1.0 0.00136 2.0 29.00273 3.0
BrazilInstance3 802033156 0.00137 EXCLUDED 0.00135 1.0 0.00167 2.0 29.00303 3.0
BrazilInstance3 856676505 0.00120 EXCLUDED 0.00133 1.0 0.00149 2.0 29.00288 3.0
BrazilInstance3 96247109 0.00111 EXCLUDED 0.00102 1.0 0.00149 2.0 32.00288 3.0
BrazilInstance4 102545520 17.00099 EXCLUDED 5.00221 2.0 1.00188 1.0 64.00258 3.0
BrazilInstance4 109328591 18.00090 EXCLUDED 3.00241 2.0 2.00202 1.0 67.00243 3.0
BrazilInstance4 234546972 18.00093 EXCLUDED 2.00238 2.0 1.00172 1.0 66.00246 3.0
BrazilInstance4 317604170 18.00093 EXCLUDED 4.00242 2.0 2.00185 1.0 66.00234 3.0
BrazilInstance4 584363925 17.00111 EXCLUDED 3.00233 1.0 4.00265 2.0 68.00243 3.0
BrazilInstance4 65843198 17.00102 EXCLUDED 3.00210 2.0 3.00201 1.0 63.00225 3.0
BrazilInstance4 792992094 17.00102 EXCLUDED 4.00223 2.0 2.00215 1.0 67.00243 3.0
BrazilInstance4 802033156 18.00083 EXCLUDED 5.00227 2.0 3.00212 1.0 68.00195 3.0
BrazilInstance4 856676505 16.00107 EXCLUDED 3.00239 2.0 3.00200 1.0 68.00222 3.0
BrazilInstance4 96247109 16.00104 EXCLUDED 3.00235 2.0 2.00150 1.0 68.00258 3.0
BrazilInstance6 102545520 4.00234 EXCLUDED 3.00273 2.0 0.00250 1.0 22.00438 3.0
BrazilInstance6 109328591 4.00225 EXCLUDED 2.00270 2.0 0.00192 1.0 23.00363 3.0
BrazilInstance6 234546972 4.00236 EXCLUDED 3.00281 2.0 0.00204 1.0 24.00369 3.0
BrazilInstance6 317604170 4.00222 EXCLUDED 3.00240 2.0 0.00218 1.0 22.00360 3.0
BrazilInstance6 584363925 4.00230 EXCLUDED 3.00284 2.0 0.00323 1.0 23.00438 3.0
BrazilInstance6 65843198 4.00228 EXCLUDED 2.00229 2.0 0.00183 1.0 25.00387 3.0
BrazilInstance6 792992094 4.00246 EXCLUDED 3.00298 2.0 0.00241 1.0 21.00423 3.0
BrazilInstance6 802033156 4.00210 EXCLUDED 3.00256 2.0 0.00191 1.0 24.00372 3.0
BrazilInstance6 856676505 4.00207 EXCLUDED 4.00270 2.0 0.00261 1.0 22.00384 3.0
BrazilInstance6 96247109 4.00228 EXCLUDED 3.00291 2.0 0.00239 1.0 23.00369 3.0
FinlandElementarySchool 102545520 0.00004 2.0 1.00004 3.0 0.00003 1.0 31.00064 4.0
FinlandElementarySchool 109328591 0.00004 2.5 0.00004 2.5 0.00003 1.0 30.00074 4.0
FinlandElementarySchool 234546972 0.00004 2.0 1.00003 3.0 0.00003 1.0 31.00080 4.0
FinlandElementarySchool 317604170 0.00003 1.5 0.00004 3.0 0.00003 1.5 31.00086 4.0
FinlandElementarySchool 584363925 0.00003 1.5 1.00003 3.0 0.00003 1.5 29.00080 4.0
FinlandElementarySchool 65843198 0.00005 2.0 1.00003 3.0 0.00003 1.0 30.00073 4.0
FinlandElementarySchool 792992094 0.00004 2.0 1.00004 3.0 0.00003 1.0 30.00049 4.0
FinlandElementarySchool 802033156 0.00003 1.5 1.00005 3.0 0.00003 1.5 29.00085 4.0
FinlandElementarySchool 856676505 0.00004 2.0 1.00003 3.0 0.00003 1.0 31.00065 4.0
FinlandElementarySchool 96247109 0.00004 2.0 1.00004 3.0 0.00003 1.0 30.00071 4.0
FinlandSecondarySchool2 102545520 0.00000 1.0 0.00015 2.0 0.00048 3.0 30.01663 4.0
FinlandSecondarySchool2 109328591 0.00000 1.0 0.00006 2.0 0.00043 3.0 30.02167 4.0
FinlandSecondarySchool2 234546972 0.00000 1.0 0.00018 2.0 0.00038 3.0 33.01473 4.0
FinlandSecondarySchool2 317604170 0.00000 1.0 1.00033 3.0 0.00034 2.0 30.01552 4.0
FinlandSecondarySchool2 584363925 0.00001 1.0 0.00018 2.0 0.00032 3.0 28.01844 4.0
FinlandSecondarySchool2 65843198 0.00002 1.0 0.00032 2.0 0.00050 3.0 29.01634 4.0
FinlandSecondarySchool2 792992094 0.00000 1.0 0.00033 3.0 0.00029 2.0 32.01630 4.0
FinlandSecondarySchool2 802033156 0.00001 1.0 0.00019 3.0 0.00014 2.0 30.01675 4.0
FinlandSecondarySchool2 856676505 0.00002 1.0 0.00023 2.0 0.00028 3.0 32.01213 4.0
FinlandSecondarySchool2 96247109 0.00004 1.0 1.00036 3.0 0.00019 2.0 32.01434 4.0
Aigio 1st High School 2010-2011 102545520 0.00010 1.0 2.00515 3.0 0.00801 2.0 51.03239 4.0
Aigio 1st High School 2010-2011 109328591 0.00010 1.0 2.00594 3.0 0.00653 2.0 52.03222 4.0
Aigio 1st High School 2010-2011 234546972 0.00018 1.0 0.00366 2.0 0.00731 3.0 53.02949 4.0
Aigio 1st High School 2010-2011 317604170 0.00018 1.0 0.00322 2.0 1.01866 3.0 45.03665 4.0
Aigio 1st High School 2010-2011 584363925 0.00006 1.0 1.00614 3.0 0.01129 2.0 53.03067 4.0
Aigio 1st High School 2010-2011 65843198 0.00020 1.0 3.00471 3.0 0.00971 2.0 50.03277 4.0
Aigio 1st High School 2010-2011 792992094 0.00008 1.0 1.00537 3.0 0.00722 2.0 48.03037 4.0
Aigio 1st High School 2010-2011 802033156 0.00022 1.0 4.00407 3.0 0.00837 2.0 50.02958 4.0
Aigio 1st High School 2010-2011 856676505 0.00012 1.0 2.00354 3.0 0.01840 2.0 49.03114 4.0
Aigio 1st High School 2010-2011 96247109 0.00006 1.0 1.00523 3.0 0.01069 2.0 49.03120 4.0
Italy_Instance4 102545520 0.00169 1.0 0.06744 3.0 0.00492 2.0 250.05966 4.0
Italy_Instance4 109328591 0.00591 1.0 0.04012 3.0 0.00797 2.0 264.06550 4.0
Italy_Instance4 234546972 0.00191 1.0 0.05996 3.0 0.00225 2.0 268.06766 4.0
Italy_Instance4 317604170 0.00691 1.0 0.10185 3.0 0.00940 2.0 263.05815 4.0
Italy_Instance4 584363925 0.00610 1.0 0.07568 3.0 0.00823 2.0 265.06947 4.0
Italy_Instance4 65843198 0.00495 1.0 1.06414 3.0 0.00500 2.0 265.06102 4.0
Italy_Instance4 792992094 0.00397 1.0 1.07815 3.0 0.00723 2.0 262.06385 4.0
Italy_Instance4 802033156 0.00387 1.0 0.06756 3.0 0.00546 2.0 259.05849 4.0
Italy_Instance4 856676505 0.00601 2.0 0.07066 3.0 0.00536 1.0 266.06742 4.0
Italy_Instance4 96247109 0.00408 1.0 0.06703 3.0 0.00924 2.0 266.06670 4.0
KosovaInstance1 102545520 57.08623 1.0 1087.18022 4.0 276.07876 2.0 992.35713 3.0
KosovaInstance1 109328591 82.10732 1.0 1065.17431 4.0 274.04939 2.0 986.42437 3.0
KosovaInstance1 234546972 48.08511 1.0 1087.14912 4.0 276.04742 2.0 991.38653 3.0
KosovaInstance1 317604170 42.09779 1.0 1086.16778 4.0 274.06707 2.0 989.41919 3.0
KosovaInstance1 584363925 56.09936 1.0 1129.13825 4.0 274.06862 2.0 989.40480 3.0
KosovaInstance1 65843198 48.09634 1.0 1121.14668 4.0 274.14587 2.0 988.41536 3.0
KosovaInstance1 792992094 38.09789 1.0 1107.14575 4.0 275.06571 2.0 989.37562 3.0
KosovaInstance1 802033156 78.08921 1.0 1122.13151 4.0 274.07965 2.0 987.42137 3.0
KosovaInstance1 856676505 59.11248 1.0 1103.12250 4.0 275.04431 2.0 988.37365 3.0
KosovaInstance1 96247109 78.11472 1.0 1127.13289 4.0 274.06726 2.0 990.38896 3.0
Kottenpark2003 102545520 0.90405 1.0 2.59417 2.0 52.99999 3.0 211.98714 4.0
Kottenpark2003 109328591 0.94483 1.0 1.60032 2.0 44.70582 3.0 213.83400 4.0
Kottenpark2003 234546972 0.87084 2.0 0.57150 1.0 58.91572 3.0 209.78966 4.0
Kottenpark2003 317604170 0.88853 1.0 1.53055 2.0 45.78932 3.0 209.85476 4.0
Kottenpark2003 584363925 0.94001 1.0 1.61955 2.0 49.54086 3.0 209.82339 4.0
Kottenpark2003 65843198 0.91064 2.0 0.47560 1.0 46.85674 3.0 212.74303 4.0
Kottenpark2003 792992094 0.94265 1.0 3.58946 2.0 56.56660 3.0 203.87920 4.0
Kottenpark2003 802033156 0.91634 2.0 0.54391 1.0 61.48750 3.0 207.90077 4.0
Kottenpark2003 856676505 2.88880 2.0 2.58810 1.0 54.55514 3.0 206.80993 4.0
Kottenpark2003 96247109 0.88609 1.0 1.53307 2.0 34.55960 3.0 207.78958 4.0
Kottenpark2005A 102545520 34.26560 2.0 29.26842 1.0 248.84276 3.0 393.40463 4.0
Kottenpark2005A 109328591 32.30723 1.0 38.30881 2.0 185.83973 3.0 402.45750 4.0
Kottenpark2005A 234546972 33.33587 1.0 33.36931 2.0 192.81517 3.0 406.50394 4.0
Kottenpark2005A 317604170 30.31203 1.0 32.30342 2.0 640.99999 4.0 407.46142 3.0
Kottenpark2005A 584363925 31.32475 1.0 45.28884 2.0 239.93207 3.0 401.59496 4.0
Kottenpark2005A 65843198 27.37026 1.0 33.28615 2.0 534.99999 4.0 405.45601 3.0
Kottenpark2005A 792992094 32.29199 2.0 26.35251 1.0 561.99999 4.0 404.44960 3.0
Kottenpark2005A 802033156 33.32444 2.0 29.31013 1.0 226.97028 3.0 395.45433 4.0
Kottenpark2005A 856676505 27.38972 1.0 28.26706 2.0 464.99999 4.0 406.42352 3.0
Kottenpark2005A 96247109 34.28892 2.0 30.28987 1.0 207.75665 3.0 406.43144 4.0
Kottenpark2008 102545520 10.33034 1.0 43.94148 2.0 105.99999 3.0 INVALID 4.0
Kottenpark2008 109328591 13.37095 1.0 39.99999 2.0 1115.99999 3.0 INVALID 4.0
Kottenpark2008 234546972 11.29414 1.0 36.84378 2.0 117.99999 3.0 INVALID 4.0
Kottenpark2008 317604170 14.37250 1.0 41.99999 2.0 95.99999 3.0 INVALID 4.0
Kottenpark2008 584363925 13.31004 1.0 50.69022 2.0 113.86636 3.0 INVALID 4.0
Kottenpark2008 65843198 12.30697 1.0 36.99999 2.0 89.99999 3.0 INVALID 4.0
Kottenpark2008 792992094 12.29698 1.0 32.71562 2.0 132.99999 3.0 INVALID 4.0
Kottenpark2008 802033156 13.29667 1.0 1046.99999 3.0 90.99999 2.0 INVALID 4.0
Kottenpark2008 856676505 16.33869 1.0 48.74396 2.0 84.99999 3.0 INVALID 4.0
Kottenpark2008 96247109 12.39381 1.0 35.99999 2.0 149.99999 3.0 INVALID 4.0
Kottenpark2009 102545520 28.14275 1.0 35.83655 2.0 99.99999 3.0 337.99999 4.0
Kottenpark2009 109328591 28.09160 1.0 35.77550 2.0 102.95850 3.0 347.99999 4.0
Kottenpark2009 234546972 31.17530 1.0 45.95020 2.0 150.99999 3.0 343.99999 4.0
Kottenpark2009 317604170 32.08205 1.0 36.99999 2.0 200.99999 3.0 343.99999 4.0
Kottenpark2009 584363925 30.08985 1.0 38.99999 2.0 105.99999 3.0 344.99999 4.0
Kottenpark2009 65843198 26.10470 1.0 33.99999 2.0 100.44435 3.0 349.99999 4.0
Kottenpark2009 792992094 26.11225 1.0 39.99999 2.0 173.99999 3.0 344.99999 4.0
Kottenpark2009 802033156 25.14030 1.0 40.82730 2.0 142.99999 3.0 344.99999 4.0
Kottenpark2009 856676505 30.13345 1.0 35.99999 2.0 108.99999 3.0 341.99999 4.0
Kottenpark2009 96247109 27.13095 1.0 39.93740 2.0 97.96060 3.0 347.99999 4.0
Woodlands2009 102545520 2.00015 2.0 2.00056 3.0 0.00112 1.0 63.00333 4.0
Woodlands2009 109328591 2.00014 2.0 2.00083 3.0 1.00103 1.0 61.00337 4.0
Woodlands2009 234546972 2.00015 2.0 3.00055 3.0 0.00094 1.0 59.00336 4.0
Woodlands2009 317604170 2.00012 2.0 2.00070 3.0 0.00114 1.0 63.00325 4.0
Woodlands2009 584363925 2.00014 1.0 2.00059 2.0 6.00110 3.0 61.00359 4.0
Woodlands2009 65843198 2.00014 1.0 2.00047 2.0 2.00113 3.0 65.00342 4.0
Woodlands2009 792992094 2.00015 2.0 2.00062 3.0 0.00094 1.0 61.00349 4.0
Woodlands2009 802033156 2.00015 2.0 2.00070 3.0 1.00091 1.0 63.00332 4.0
Woodlands2009 856676505 2.00018 1.0 2.00134 3.0 2.00121 2.0 62.00342 4.0
Woodlands2009 96247109 2.00012 2.0 2.00068 3.0 0.00117 1.0 62.00327 4.0
Spanish school 102545520 0.00956 1.0 0.01757 2.0 0.02490 3.0 63.13993 4.0
Spanish school 109328591 0.00597 1.0 0.01937 2.0 0.03442 3.0 66.14225 4.0
Spanish school 234546972 0.00751 1.0 0.01715 2.0 0.01927 3.0 66.12368 4.0
Spanish school 317604170 0.00688 1.0 0.01247 2.0 0.04475 3.0 67.14512 4.0
Spanish school 584363925 0.01062 1.0 0.01527 2.0 0.02576 3.0 63.13873 4.0
Spanish school 65843198 0.01017 1.0 0.01417 2.0 0.02682 3.0 67.12595 4.0
Spanish school 792992094 0.00707 1.0 0.01661 2.0 0.02380 3.0 63.14351 4.0
Spanish school 802033156 0.01472 1.0 0.01785 2.0 0.02490 3.0 67.13265 4.0
Spanish school 856676505 0.01061 1.0 0.01667 2.0 0.02424 3.0 69.12679 4.0
Spanish school 96247109 0.00631 1.0 0.01967 2.0 0.02315 3.0 63.14672 4.0
WesternGreeceUniversityInstance3 102545520 0.00006 1.0 0.00010 2.0 30.00002 4.0 16.00174 3.0
WesternGreeceUniversityInstance3 109328591 0.00006 1.0 0.00014 2.0 30.00002 4.0 14.00198 3.0
WesternGreeceUniversityInstance3 234546972 0.00006 1.0 0.00010 2.0 30.00002 4.0 14.00209 3.0
WesternGreeceUniversityInstance3 317604170 0.00006 1.0 0.00011 2.0 30.00002 4.0 15.00183 3.0
WesternGreeceUniversityInstance3 584363925 0.00005 1.0 0.00011 2.0 30.00003 4.0 16.00194 3.0
WesternGreeceUniversityInstance3 65843198 0.00005 1.0 0.00010 2.0 30.00002 4.0 14.00199 3.0
WesternGreeceUniversityInstance3 792992094 0.00006 1.0 0.00010 2.0 30.00002 4.0 15.00177 3.0
WesternGreeceUniversityInstance3 802033156 0.00006 1.0 0.00011 2.0 30.00003 4.0 16.00193 3.0
WesternGreeceUniversityInstance3 856676505 0.00006 1.0 0.00011 2.0 30.00004 4.0 14.00198 3.0
WesternGreeceUniversityInstance3 96247109 0.00006 1.0 0.00015 2.0 30.00002 4.0 15.00171 3.0
WesternGreeceUniversityInstance4 102545520 0.00006 1.0 0.00018 2.0 36.00083 3.0 233.00277 4.0
WesternGreeceUniversityInstance4 109328591 0.00007 1.0 0.00025 2.0 35.00101 3.0 239.00277 4.0
WesternGreeceUniversityInstance4 234546972 0.00009 1.0 0.00025 2.0 37.00114 3.0 235.00285 4.0
WesternGreeceUniversityInstance4 317604170 0.00008 1.0 0.00019 2.0 36.00076 3.0 235.00285 4.0
WesternGreeceUniversityInstance4 584363925 0.00007 1.0 0.00022 2.0 35.00101 3.0 237.00281 4.0
WesternGreeceUniversityInstance4 65843198 0.00008 1.0 0.00016 2.0 35.00070 3.0 239.00280 4.0
WesternGreeceUniversityInstance4 792992094 0.00006 1.0 0.00026 2.0 35.00082 3.0 238.00265 4.0
WesternGreeceUniversityInstance4 802033156 0.00007 1.0 0.00020 2.0 35.00083 3.0 237.00297 4.0
WesternGreeceUniversityInstance4 856676505 0.00008 1.0 0.00020 2.0 36.00128 3.0 237.00284 4.0
WesternGreeceUniversityInstance4 96247109 0.00005 1.0 0.00016 2.0 35.00111 3.0 236.00277 4.0
WesternGreeceUniversityInstance5 102545520 0.00000 1.0 0.00007 2.0 4.00016 3.0 11.00149 4.0
WesternGreeceUniversityInstance5 109328591 0.00000 1.0 0.00001 2.0 4.00022 3.0 11.00159 4.0
WesternGreeceUniversityInstance5 234546972 0.00000 1.0 0.00005 2.0 4.00017 3.0 12.00164 4.0
WesternGreeceUniversityInstance5 317604170 0.00000 1.0 0.00003 2.0 4.00015 3.0 11.00142 4.0
WesternGreeceUniversityInstance5 584363925 0.00000 1.0 0.00001 2.0 4.00019 3.0 12.00164 4.0
WesternGreeceUniversityInstance5 65843198 0.00000 1.0 0.00003 2.0 4.00017 3.0 11.00158 4.0
WesternGreeceUniversityInstance5 792992094 0.00000 1.0 0.00007 2.0 4.00013 3.0 12.00162 4.0
WesternGreeceUniversityInstance5 802033156 0.00000 1.0 0.00004 2.0 4.00019 3.0 12.00155 4.0
WesternGreeceUniversityInstance5 856676505 0.00000 1.0 0.00001 2.0 4.00032 3.0 9.00174 4.0
WesternGreeceUniversityInstance5 96247109 0.00000 1.0 0.00003 2.0 4.00016 3.0 12.00153 4.0
Sum of ranks   165.0   401.5   417.5   656.0
Number of ranks   140   180   180   180
Average rank   1.18   2.23   2.32   3.64

The solution groups appear from left to right in order of increasing average rank as defined by the rules of the Third International Timetabling Competition. Each row represents one trial: one instance plus one random seed. Under each solution group is the result of that trial in that solution group: a cost plus the rank of that cost within the row. If the solution group contains no solution for that trial, or the solution is invalid, the cost is ABSENT or INVALID and the rank is maximal; if it contains two or more solutions the cost is DUPLICATE and the rank is maximal. If the solution is required to be excluded, its cost is given but its rank is EXCLUDED. The last three rows contain, for each solution group, the sum of its ranks, the number of ranks, and the quotient of those quantities.

Invalid solutions

For each invalid solution, this listing shows its index within its solution group and the position and nature of its first error.

In solution group HFT:
Solution 111 (line 2189533 col 13:


HSEval Software Copyright Jeffrey H. Kingston 2012