Benchmark Results¶
Solver Benchmarks¶
These benchmarks were run on a [computer specifications].
The following solvers were tested:Gurobi - [version]
CPLEX - [version]
COPT - [version]
The recorded values under each solver represent the best objective score found.
Edwards-Anderson Solver Benchmark¶
Spins |
Seed |
Gurobi |
ILOG CPLEX |
COPT |
|---|---|---|---|---|
100 |
1 |
-78.6504016840062 |
-78.6504016840062 |
-78.6504016840062 |
100 |
2 |
-67.172057869299 |
-67.172057869299 |
-70.0870798958614 |
100 |
3 |
-70.7777921590581 |
-70.7777921590581 |
-71.28637772332 |
100 |
4 |
-73.1392899585965 |
-73.1392899585965 |
-72.0846409531129 |
100 |
5 |
-74.621299992447 |
-74.621299992447 |
-82.2392567506142 |
100 |
6 |
-76.7191304112367 |
-76.7191304112367 |
-70.3325321624979 |
100 |
7 |
-73.3272999525439 |
-73.3272999525438 |
-74.0883581197803 |
100 |
8 |
-75.1618765307825 |
-75.1618765307825 |
-70.4026605865973 |
100 |
9 |
-70.850549950409 |
-70.8505499504091 |
-70.0424053108145 |
100 |
10 |
-70.0870798958614 |
-70.0870798958614 |
-73.851408590919 |
100 |
11 |
-71.28637772332 |
-71.28637772332 |
-80.0025811196057 |
100 |
12 |
-72.0846409531129 |
-72.0846409531129 |
-67.172057869299 |
100 |
13 |
-82.2392567506142 |
-82.2392567506142 |
-71.4689600745589 |
100 |
14 |
-70.3325321624979 |
-70.3325321624979 |
-75.3332956142594 |
100 |
15 |
-74.0883581197803 |
-74.0883581197803 |
-75.5343469621385 |
100 |
16 |
-70.4026605865973 |
-70.4026605865973 |
-73.4247665687752 |
100 |
17 |
-70.0424053108145 |
-70.0424053108145 |
-72.6150190546339 |
100 |
18 |
-73.851408590919 |
-73.851408590919 |
-70.9973874229352 |
100 |
19 |
-80.0025811196057 |
-80.0025811196057 |
-70.7777921590581 |
100 |
20 |
-71.4689600745589 |
-71.4689600745589 |
-73.1392899585965 |
100 |
21 |
-75.3332956142594 |
-75.3332956142594 |
-74.621299992447 |
100 |
22 |
-75.5343469621385 |
-75.5343469621385 |
-76.7191304112367 |
100 |
23 |
-73.4247665687752 |
-73.4247665687752 |
-73.3272999525438 |
100 |
24 |
-72.6150190546339 |
-72.6150190546339 |
-75.1618765307825 |
100 |
25 |
-70.9973874229352 |
-70.9973874229352 |
-70.8505499504091 |
400 |
1 |
-313.565293005887 |
-313.565293005887 |
-313.565293005886 |
400 |
2 |
-304.548628044857 |
-304.548628044857 |
-304.548628044857 |
400 |
3 |
-293.4026638419 |
-293.402663841901 |
-293.4026638419 |
400 |
4 |
-313.87021387254 |
-313.87021387254 |
-313.87021387254 |
400 |
5 |
-301.800184726451 |
-301.800184726451 |
-301.80018472645 |
400 |
6 |
-306.372005898745 |
-306.372005898745 |
-306.372005898744 |
400 |
7 |
-306.71491659424 |
-306.71491659424 |
-306.71491659424 |
400 |
8 |
-304.514918657809 |
-304.514918657809 |
-304.514918657808 |
400 |
9 |
-289.028526115964 |
-289.028526115965 |
-289.028526115964 |
400 |
10 |
-306.971440243233 |
-306.971440243233 |
-306.971440243232 |
400 |
11 |
-309.565380165954 |
-309.565380165954 |
-309.56538016595 |
400 |
12 |
-302.419569993211 |
-302.419569993211 |
-302.419569993211 |
400 |
13 |
-313.510427471047 |
-313.510427471047 |
-313.510427471046 |
400 |
14 |
-307.114166417187 |
-307.114166417187 |
-307.114166417187 |
400 |
15 |
-320.890933031867 |
-320.890933031867 |
-320.890933031867 |
400 |
16 |
-305.071752766978 |
-305.071752766978 |
-305.071752766978 |
400 |
17 |
-306.674076424297 |
-306.674076424298 |
-306.674076424295 |
400 |
18 |
-299.92972264119 |
-299.92972264119 |
-299.929722641188 |
400 |
19 |
-307.490823851513 |
-307.490823851513 |
-307.490823851511 |
400 |
20 |
-307.17171621278 |
-307.171716212781 |
-307.17171621278 |
400 |
21 |
-313.111976299986 |
-313.111976299986 |
-313.111976299986 |
400 |
22 |
-309.295807622231 |
-309.295807622231 |
-309.295807622231 |
400 |
23 |
-302.456067476856 |
-302.456067476856 |
-302.456067476854 |
400 |
24 |
-307.200749022524 |
-307.200749022524 |
-307.200749022524 |
400 |
25 |
-308.802213957094 |
-308.802213957094 |
-308.802213957071 |
1600 |
1 |
-1234.98769762046 |
-1234.98769762046 |
-1234.98769762046 |
1600 |
2 |
-1262.07152051993 |
-1262.07152051994 |
-1262.07152051992 |
1600 |
3 |
-1253.741406424 |
-1253.741406424 |
-1253.741406424 |
1600 |
4 |
-1261.34588327997 |
-1261.34588327998 |
-1261.34588327989 |
1600 |
5 |
-1245.56387946891 |
-1245.56387946891 |
-1245.5638794682 |
1600 |
6 |
-1264.83208119137 |
-1264.83208119137 |
-1264.83208119134 |
1600 |
7 |
-1244.99670173913 |
-1244.99670173913 |
-1244.99670174024 |
1600 |
8 |
-1228.76153062345 |
-1228.76153062345 |
-1228.76153062345 |
1600 |
9 |
-1227.96088291988 |
-1227.96088291988 |
-1227.96088293966 |
1600 |
10 |
-1279.52366600704 |
-1279.52366600704 |
-1279.52366600705 |
1600 |
11 |
-1230.0479682866 |
-1230.04796828661 |
-1230.0479682866 |
1600 |
12 |
-1237.68020820023 |
-1237.68020820023 |
-1237.68020820014 |
1600 |
13 |
-1249.94595249163 |
-1249.94595249163 |
-1249.94595249161 |
1600 |
14 |
-1222.82926399811 |
-1222.82926399811 |
-1222.82926399638 |
1600 |
15 |
-1228.21499836174 |
-1228.21499836174 |
-1228.21499836172 |
1600 |
16 |
-1228.49927411044 |
-1228.49927411044 |
-1228.49927410874 |
1600 |
17 |
-1241.52748037366 |
-1241.52748037366 |
-1241.52748037295 |
1600 |
18 |
-1226.05242130809 |
-1226.05242130809 |
-1226.05242129662 |
1600 |
19 |
-1213.98737465815 |
-1213.98737465815 |
-1213.98737465843 |
1600 |
20 |
-1253.92580096363 |
-1253.92580096363 |
-1253.92580096338 |
1600 |
21 |
-1243.85425429518 |
-1243.85425429518 |
-1243.85425429455 |
1600 |
22 |
-1251.08846318527 |
-1251.08846318527 |
-1251.08846318538 |
1600 |
23 |
-1246.61063929586 |
-1246.61063929586 |
-1246.61063929586 |
1600 |
24 |
-1248.50124863307 |
-1248.50124863307 |
-1248.50124863246 |
1600 |
25 |
-1251.58467104776 |
-1251.58467104776 |
-1251.58467104773 |
Sherrington-Kirkpatrick Solver Benchmark¶
Spins |
Seed |
Gurobi |
ILOG CPLEX |
COPT |
|---|---|---|---|---|
100 |
1 |
-7.15560486493782 |
-7.15560486493782 |
-3.06779104455769 |
100 |
2 |
-7.2579284937085 |
-7.25792849370851 |
-3.52344914092256 |
100 |
3 |
-7.15262779869878 |
-7.15262779869878 |
-2.7938482648491 |
100 |
4 |
-7.07302342280588 |
-7.084221832221 |
-4.56667847605106 |
100 |
5 |
-7.32613355733995 |
-7.32613355733996 |
-3.64603759475785 |
100 |
6 |
-7.31397101875491 |
-7.31397101875492 |
-3.64754994463757 |
100 |
7 |
-7.22477222573391 |
-7.22477222573393 |
-2.1700221325054 |
100 |
8 |
-7.70957560343447 |
-7.70957560343446 |
-3.95231896467058 |
100 |
9 |
-7.17197824722189 |
-7.1719782472219 |
-3.58314246598767 |
100 |
10 |
-6.96507435959595 |
-6.96507435959598 |
-2.63656711879312 |
100 |
11 |
-7.0926968695959 |
-7.0926968695959 |
-2.07853838378412 |
100 |
12 |
-6.963154701819 |
-6.96315470181899 |
nan |
100 |
13 |
-7.15330090420227 |
-7.15330090420228 |
nan |
100 |
14 |
-7.24041545026889 |
-7.24041545026889 |
nan |
100 |
15 |
-7.04570662198424 |
-7.04570662198424 |
nan |
100 |
16 |
-7.42172262008944 |
-7.42172262008945 |
nan |
100 |
17 |
-7.29288422190511 |
-7.29288422190511 |
nan |
100 |
18 |
-7.11056447162426 |
-7.11056447162427 |
nan |
100 |
19 |
-7.42954978041864 |
-7.42954978041863 |
nan |
100 |
20 |
-7.19411799390721 |
-7.19411799390722 |
nan |
100 |
21 |
-7.18737304201117 |
-7.18737304201118 |
nan |
100 |
22 |
-7.31988174310147 |
-7.31988174310148 |
nan |
100 |
23 |
-7.30788985553713 |
-7.30788985553713 |
nan |
100 |
24 |
-7.06352080380241 |
-7.06352080380241 |
nan |
100 |
25 |
-7.07670546144979 |
-7.0767054614498 |
nan |
Ising Chain Solver Benchmark¶
Spins |
Seed |
Gurobi |
ILOG CPLEX |
COPT |
|---|---|---|---|---|
32 |
1 |
-13.1617824460794 |
-13.1617824460794 |
-13.1617824460794 |
32 |
2 |
-11.8206070562495 |
-11.8206070562495 |
-11.8206070562495 |
32 |
3 |
-14.3412914323265 |
-14.3412914323265 |
-14.3412914323265 |
32 |
4 |
-16.4911488701018 |
-16.4911488701018 |
-16.4911488701018 |
32 |
5 |
-13.7570649581804 |
-13.7570649581804 |
-13.7570649581804 |
32 |
6 |
-17.5183229844167 |
-17.5183229844167 |
-17.5183229844167 |
32 |
7 |
-15.6124868206676 |
-15.6124868206676 |
-15.6124868206676 |
32 |
8 |
-15.1964272005591 |
-15.1964272005591 |
-15.1964272005591 |
32 |
9 |
-16.1056323782902 |
-16.1056323782902 |
-16.1056323782902 |
32 |
10 |
-16.1354951215699 |
-16.1354951215699 |
-16.1354951215699 |
32 |
11 |
-13.2706717261508 |
-13.2706717261508 |
-13.2706717261508 |
32 |
12 |
-14.8604441532138 |
-14.8604441532138 |
-14.8604441532138 |
32 |
13 |
-15.8258131298162 |
-15.8258131298162 |
-15.8258131298162 |
32 |
14 |
-15.8597114552995 |
-15.8597114552995 |
-15.8597114552995 |
32 |
15 |
-13.071059391701 |
-13.071059391701 |
-13.071059391701 |
32 |
16 |
-13.0400471836076 |
-13.0400471836076 |
-13.0400471836076 |
32 |
17 |
-13.526093921151 |
-13.5260939211509 |
-13.5260939211509 |
32 |
18 |
-17.0963282578451 |
-17.0963282578451 |
-17.0963282578451 |
32 |
19 |
-14.7157051591725 |
-14.7157051591725 |
-14.7157051591725 |
32 |
20 |
-17.387661407648 |
-17.387661407648 |
-17.387661407648 |
32 |
21 |
-14.1910760343979 |
-14.1910760343979 |
-14.1910760343979 |
32 |
22 |
-16.4035611539225 |
-16.4035611539225 |
-16.4035611539225 |
32 |
23 |
-15.680206130729 |
-15.680206130729 |
-15.680206130729 |
32 |
24 |
-18.7985785564051 |
-18.7985785564051 |
-18.7985785564051 |
32 |
25 |
-14.2958603184562 |
-14.2958603184562 |
-14.2958603184562 |
64 |
1 |
-28.2897936040369 |
-28.2897936040369 |
-28.2897936040369 |
64 |
2 |
-29.390447554682 |
-29.390447554682 |
-29.390447554682 |
64 |
3 |
-29.4574962523084 |
-29.4574962523084 |
-29.4574962523084 |
64 |
4 |
-32.9461077273758 |
-32.9461077273758 |
-32.9461077273757 |
64 |
5 |
-31.3387273965978 |
-31.3387273965978 |
-31.3387273965978 |
64 |
6 |
-35.8099095153801 |
-35.8099095153801 |
-35.8099095153801 |
64 |
7 |
-31.4772382467431 |
-31.4772382467431 |
-31.4772382467431 |
64 |
8 |
-31.4723017333969 |
-31.4723017333969 |
-31.4723017333969 |
64 |
9 |
-32.5885654737982 |
-32.5885654737982 |
-32.5885654737982 |
64 |
10 |
-32.4342436665463 |
-32.4342436665463 |
-32.4342436665463 |
64 |
11 |
-29.7679396022533 |
-29.7679396022533 |
-29.7679396022533 |
64 |
12 |
-29.7771315429751 |
-29.7771315429751 |
-29.7771315429751 |
64 |
13 |
-30.2073789040467 |
-30.2073789040467 |
-30.2073789040467 |
64 |
14 |
-30.6526338262066 |
-30.6526338262066 |
-30.6526338262066 |
64 |
15 |
-26.2433448726348 |
-26.2433448726349 |
-26.2433448726348 |
64 |
16 |
-28.4118473307417 |
-28.4118473307417 |
-28.4118473307417 |
64 |
17 |
-30.6161514120509 |
-30.6161514120509 |
-30.6161514120509 |
64 |
18 |
-32.1551586185746 |
-32.1551586185746 |
-32.1551586185746 |
64 |
19 |
-31.7454877324573 |
-31.7454877324573 |
-31.7454877324573 |
64 |
20 |
-33.1215838422734 |
-33.1215838422734 |
-33.1215838422734 |
64 |
21 |
-33.4069595376837 |
-33.4069595376837 |
-33.4069595376837 |
64 |
22 |
-30.1303066277395 |
-30.1303066277395 |
-30.1303066277395 |
64 |
23 |
-31.7161931450743 |
-31.7161931450743 |
-31.7161931450743 |
64 |
24 |
-37.5729175856893 |
-37.5729175856893 |
-37.5729175856893 |
64 |
25 |
-31.8505693402429 |
-31.8505693402429 |
-31.8505693402429 |
128 |
1 |
-62.3954203551137 |
-62.3954203551137 |
-62.3954203551137 |
128 |
2 |
-59.4799023259207 |
-59.4799023259206 |
-59.4799023259206 |
128 |
3 |
-61.7999363302589 |
-61.7999363302589 |
-61.7999363302589 |
128 |
4 |
-67.06292451538 |
-67.0629245153798 |
-67.0629245153798 |
128 |
5 |
-65.1081719690614 |
-65.1081719690614 |
-65.1081719690614 |
128 |
6 |
-65.1005531482722 |
-65.1005531482722 |
-65.1005531482722 |
128 |
7 |
-64.3395262274528 |
-64.3395262274529 |
-64.3395262274528 |
128 |
8 |
-65.3801895817853 |
-65.3801895817853 |
-65.3801895817852 |
128 |
9 |
-61.8794595895277 |
-61.8794595895277 |
-61.8794595895277 |
128 |
10 |
-60.1466791636232 |
-60.1466791636233 |
-60.1466791636232 |
128 |
11 |
-64.6454439753922 |
-64.6454439753922 |
-64.6454439753922 |
128 |
12 |
-63.1399762690793 |
-63.1399762690792 |
-63.1399762690792 |
128 |
13 |
-59.4676027785263 |
-59.4676027785262 |
-59.4676027785262 |
128 |
14 |
-59.689164990213 |
-59.6891649902131 |
-59.689164990213 |
128 |
15 |
-58.8594510666099 |
-58.8594510666099 |
-58.8594510666099 |
128 |
16 |
-63.3654367718165 |
-63.3654367718166 |
-63.3654367718165 |
128 |
17 |
-65.5746347002038 |
-65.5746347002037 |
-65.5746347002037 |
128 |
18 |
-64.0116720441086 |
-64.0116720441086 |
-64.0116720441085 |
128 |
19 |
-66.6478768164257 |
-66.6478768164257 |
-66.6478768164257 |
128 |
20 |
-65.8171174478803 |
-65.8171174478803 |
-65.8171174478803 |
128 |
21 |
-66.2257330185889 |
-66.2257330185889 |
-66.2257330185889 |
128 |
22 |
-62.9515015846954 |
-62.9515015846954 |
-62.9515015846954 |
128 |
23 |
-62.1408453309808 |
-62.1408453309809 |
-62.1408453309808 |
128 |
24 |
-68.3932302870547 |
-68.3932302870548 |
-68.3932302870547 |
128 |
25 |
-60.6364088703169 |
-60.6364088703169 |
-60.6364088703169 |
Wishart-Planted Ensemble Solver Benchmark¶
Spins |
Seed |
Alpha |
Gurobi |
ILOG CPLEX |
COPT |
|---|---|---|---|---|---|
32 |
1 |
0.25 |
-3.9314516139 |
-3.9314516139 |
-3.9314516139 |
32 |
2 |
0.25 |
-3.9637096784 |
-3.96370967840001 |
-3.9637096784 |
32 |
3 |
0.25 |
-4.0403225815 |
-4.0403225815 |
-4.04032258150012 |
32 |
4 |
0.25 |
-4.01814516 |
-4.01814516 |
-4.01814516000001 |
32 |
5 |
0.25 |
-4.1028225832 |
-4.1028225832 |
-4.1028225832 |
32 |
6 |
0.25 |
-4.00806451529999 |
-4.00806451529999 |
-4.00806451529999 |
32 |
7 |
0.25 |
-4.080645161 |
-4.080645161 |
-4.08064516100001 |
32 |
8 |
0.25 |
-4.02419354829999 |
-4.0241935483 |
-4.02419354829998 |
32 |
9 |
0.25 |
-4.07862903139999 |
-4.07862903140001 |
-4.07862903140313 |
32 |
10 |
0.25 |
-3.9697580658 |
-3.9697580658 |
-3.9697580658 |
32 |
11 |
0.25 |
-3.87903225819999 |
-3.8790322582 |
-3.87903225819999 |
32 |
12 |
0.25 |
-4.04032257949999 |
-4.0403225795 |
-4.04032257949999 |
32 |
13 |
0.25 |
-4.0665322595 |
-4.0665322595 |
-4.0665322595 |
32 |
14 |
0.25 |
-4.0625000015 |
-4.0625000015 |
-4.06250000149999 |
32 |
15 |
0.25 |
-3.91129032329999 |
-3.91129032329999 |
-3.91129032329999 |
32 |
16 |
0.25 |
-4.03024193669999 |
-4.03024193669999 |
-4.0302419367 |
32 |
17 |
0.25 |
-3.9616935474 |
-3.9616935474 |
-3.9616935474 |
32 |
18 |
0.25 |
-3.8165322595 |
-3.8165322595 |
-3.8165322595 |
32 |
19 |
0.25 |
-3.9052419351 |
-3.90524193510001 |
-3.9052419351 |
32 |
20 |
0.25 |
-4.01814515929999 |
-4.0181451593 |
-4.0181451593 |
32 |
21 |
0.25 |
-3.90524193629999 |
-3.90524193629999 |
-3.90524193629992 |
32 |
22 |
0.25 |
-4.0120967742 |
-4.0120967742 |
-4.01209677419999 |
32 |
23 |
0.25 |
-3.97177419379999 |
-3.9717741938 |
-3.97177419379999 |
32 |
24 |
0.25 |
-4.06250000089999 |
-4.06250000089999 |
-4.06250000089999 |
32 |
25 |
0.25 |
-4.0120967737 |
-4.0120967737 |
-4.01209677370001 |
32 |
1 |
0.5 |
-8.0725806451 |
-8.0725806451 |
-8.0725806451 |
32 |
2 |
0.5 |
-7.9334677414 |
-7.93346774140001 |
-7.9334677414 |
32 |
3 |
0.5 |
-7.9798387092 |
-7.9798387092 |
-7.9798387092 |
32 |
4 |
0.5 |
-7.98185483879999 |
-7.98185483880002 |
-7.98185483879922 |
32 |
5 |
0.5 |
-7.92338709609999 |
-7.92338709609999 |
-7.92338709609987 |
32 |
6 |
0.5 |
-7.9133064519 |
-7.91330645190001 |
-7.9133064519 |
32 |
7 |
0.5 |
-8.10887096750001 |
-8.10887096750004 |
-8.10887096749991 |
32 |
8 |
0.5 |
-8.0000000009 |
-8.00000000090003 |
-8.0000000009 |
32 |
9 |
0.5 |
-8.0826612908 |
-8.08266129080003 |
-8.0826612908 |
32 |
10 |
0.5 |
-8.1209677422 |
-8.12096774220002 |
-8.1209677422 |
32 |
11 |
0.5 |
-7.8709677403 |
-7.8709677403 |
-7.8709677403 |
32 |
12 |
0.5 |
-7.9213709678 |
-7.9213709678 |
-7.9213709678 |
32 |
13 |
0.5 |
-8.01411290429999 |
-8.01411290430002 |
-8.01411290430023 |
32 |
14 |
0.5 |
-8.08870967659999 |
-8.08870967659999 |
-8.08870967659999 |
32 |
15 |
0.5 |
-7.92943548399999 |
-7.92943548399999 |
-7.92943548399999 |
32 |
16 |
0.5 |
-7.9072580645 |
-7.90725806450002 |
-7.90725806450012 |
32 |
17 |
0.5 |
-8.0685483872 |
-8.06854838720001 |
-8.06854838719919 |
32 |
18 |
0.5 |
-8.11693548429999 |
-8.11693548429999 |
-8.11693548429999 |
32 |
19 |
0.5 |
-7.81048387049999 |
-7.81048387050002 |
-7.81048387049999 |
32 |
20 |
0.5 |
-7.9717741953 |
-7.9717741953 |
-7.9717741953 |
32 |
21 |
0.5 |
-7.9455645158 |
-7.9455645158 |
-7.94556451580002 |
32 |
22 |
0.5 |
-8.0181451622 |
-8.0181451622 |
-8.0181451622 |
32 |
23 |
0.5 |
-7.95362903279999 |
-7.95362903280002 |
-7.95362903279999 |
32 |
24 |
0.5 |
-8.1612903227 |
-8.1612903227 |
-8.1612903227 |
32 |
25 |
0.5 |
-7.92338709579999 |
-7.9233870958 |
-7.9233870958 |
2-D Spin Glass Solver Benchmark¶
Spins |
Instance # |
Gurobi |
ILOG CPLEX |
COPT |
|---|---|---|---|---|
400 |
1 |
-518.684078830337 |
-518.684078830337 |
-518.68407883033 |
400 |
2 |
-555.264344305488 |
-555.264344305488 |
-555.264344305488 |
400 |
3 |
-534.827006629501 |
-534.827006629501 |
-534.827006629501 |
400 |
4 |
-527.901108958341 |
-527.901108958342 |
-527.901108958341 |
400 |
5 |
-529.746512715738 |
-529.746512715738 |
-529.746512715738 |
400 |
6 |
-544.877975365413 |
-544.877975365413 |
-544.877975365413 |
400 |
7 |
-551.628057291209 |
-551.628057291209 |
-551.628057291206 |
400 |
8 |
-548.313808219784 |
-548.313808219784 |
-548.313808219782 |
400 |
9 |
-495.579317372678 |
-495.579317372679 |
-495.579317372679 |
400 |
10 |
-534.849556106079 |
-534.849556106079 |
-534.849556106079 |
400 |
11 |
-535.871791017694 |
-535.871791017694 |
-535.871791017694 |
400 |
12 |
-515.443144271918 |
-515.443144271918 |
-515.443144271918 |
400 |
13 |
-546.995689975553 |
-546.995689975554 |
-546.995689975553 |
400 |
14 |
-492.629389273191 |
-492.629389273191 |
-492.629389273151 |
400 |
15 |
-531.634092005834 |
-531.634092005834 |
-531.634092005834 |
400 |
16 |
-514.261500523041 |
-514.261500523041 |
-514.261500523041 |
400 |
17 |
-519.914951795954 |
-519.914951795955 |
-519.914951795954 |
400 |
18 |
-542.552664909225 |
-542.552664909225 |
-542.552664909224 |
400 |
19 |
-549.427427027473 |
-549.427427027473 |
-549.427427027472 |
400 |
20 |
-519.328999431174 |
-519.328999431174 |
-519.328999431172 |
400 |
21 |
-529.342618964648 |
-529.342618964648 |
-529.342618964637 |
400 |
22 |
-496.457312377597 |
-496.457312377597 |
-496.457312377597 |
400 |
23 |
-550.070309061116 |
-550.070309061116 |
-550.0703090611 |
400 |
24 |
-533.115737349184 |
-533.115737349184 |
-533.115737349185 |
400 |
25 |
-543.956208088802 |
-543.956208088802 |
-543.956208088801 |
625 |
1 |
-832.093755643963 |
-832.093755643963 |
-832.093755643961 |
625 |
2 |
-820.771796772091 |
-820.771796772092 |
-820.771796772088 |
625 |
3 |
-847.386390009708 |
-847.386390009708 |
-847.386390009685 |
625 |
4 |
-800.042200814146 |
-800.042200814146 |
-800.042200814144 |
625 |
5 |
-828.607116601658 |
-828.607116601659 |
-828.607116601618 |
625 |
6 |
-795.539346427995 |
-795.539346427995 |
-795.539346427994 |
625 |
7 |
-845.535234358067 |
-845.535234358067 |
-845.535234358066 |
625 |
8 |
-823.780702040359 |
-823.780702040359 |
-823.780702040335 |
625 |
9 |
-838.588701780546 |
-838.588701780547 |
-838.588701780392 |
625 |
10 |
-792.990172806979 |
-792.990172806979 |
-792.99017280698 |
625 |
11 |
-818.212903748404 |
-818.212903748404 |
-818.212903748404 |
625 |
12 |
-839.090401351668 |
-839.090401351669 |
-839.090401351668 |
625 |
13 |
-809.542291175095 |
-809.542291175096 |
-809.542291175055 |
625 |
14 |
-810.308396209368 |
-810.308396209368 |
-810.308396209367 |
625 |
15 |
-869.585875224702 |
-869.585875224703 |
-869.585875224696 |
625 |
16 |
-812.531244243736 |
-812.531244243737 |
-812.531244243729 |
625 |
17 |
-805.367554318096 |
-805.367554318096 |
-805.367554318094 |
625 |
18 |
-841.668645182489 |
-841.668645182489 |
-841.668645182525 |
625 |
19 |
-832.706072090083 |
-832.706072090083 |
-832.706072090069 |
625 |
20 |
-828.621311144242 |
-828.621311144243 |
-828.621311144222 |
625 |
21 |
-782.279844630405 |
-782.279844630405 |
-782.279844630391 |
625 |
22 |
-834.54164235679 |
-834.541642356791 |
-834.541642356789 |
625 |
23 |
-816.842960466742 |
-816.842960466743 |
-816.842960466739 |
625 |
24 |
-830.965745183334 |
-830.965745183334 |
-830.965745183334 |
625 |
25 |
-817.468473333202 |
-817.468473333202 |
-817.468473333216 |
900 |
1 |
-1171.01561908813 |
-1171.01561908814 |
-1171.01561908813 |
900 |
2 |
-1154.31690698909 |
-1154.31690698909 |
-1154.31690698907 |
900 |
3 |
-1173.73426328083 |
-1173.73426328083 |
-1173.73426328049 |
900 |
4 |
-1221.89490838943 |
-1221.89490838943 |
-1221.89490838943 |
900 |
5 |
-1184.29881936605 |
-1184.29881936605 |
-1184.29881936605 |
900 |
6 |
-1165.10521262935 |
-1165.10521262935 |
-1165.10521262934 |
900 |
7 |
-1169.6512085191 |
-1169.6512085191 |
-1169.6512085191 |
900 |
8 |
-1201.29567432493 |
-1201.29567432493 |
-1201.29567432504 |
900 |
9 |
-1176.32315865401 |
-1176.32315865401 |
-1176.32315865399 |
900 |
10 |
-1178.68227623533 |
-1178.68227623533 |
-1178.6822762353 |
900 |
11 |
-1192.40572345896 |
-1192.40572345896 |
-1192.40572345896 |
900 |
12 |
-1187.36305305636 |
-1187.36305305636 |
-1187.36305305518 |
900 |
13 |
-1222.89112601152 |
-1222.89112601152 |
-1222.89112601152 |
900 |
14 |
-1171.64137136897 |
-1171.64137136897 |
-1171.64137136895 |
900 |
15 |
-1183.44698487215 |
-1183.44698487215 |
-1183.44698487214 |
900 |
16 |
-1171.06422520325 |
-1171.06422520325 |
-1171.06422520323 |
900 |
17 |
-1172.21927452626 |
-1172.21927452626 |
-1172.2192745266 |
900 |
18 |
-1152.22489821515 |
-1152.22489821515 |
-1152.22489821515 |
900 |
19 |
-1164.32777753687 |
-1164.32777753687 |
-1164.32777753687 |
900 |
20 |
-1242.02279365211 |
-1242.02279365211 |
-1242.02279365211 |
900 |
21 |
-1159.75574037958 |
-1159.75574037958 |
-1159.75574037958 |
900 |
22 |
-1186.08849022016 |
-1186.08849022016 |
-1186.08849022015 |
900 |
23 |
-1150.07127555983 |
-1150.07127555983 |
-1150.07127555981 |
900 |
24 |
-1183.23689526705 |
-1183.23689526705 |
-1183.23689526706 |
900 |
25 |
-1199.33596100233 |
-1199.33596100234 |
-1199.33596100232 |
1225 |
1 |
-1578.54008886806 |
-1578.54008886806 |
-1578.54008886764 |
1225 |
2 |
-1600.90820283782 |
-1600.90820283782 |
-1600.90820283781 |
1225 |
3 |
-1581.07582092948 |
-1581.07582092948 |
-1581.07582092907 |
1225 |
4 |
-1606.58887434341 |
-1606.58887434341 |
-1606.58887434337 |
1225 |
5 |
-1599.49393154825 |
-1599.49393154825 |
-1599.49393154872 |
1225 |
6 |
-1577.06807663441 |
-1577.06807663441 |
-1577.0680766342 |
1225 |
7 |
-1630.7424690954 |
-1630.7424690954 |
-1630.74246909711 |
1225 |
8 |
-1609.55840184087 |
-1609.55840184087 |
-1609.55840184082 |
1225 |
9 |
-1616.36933164074 |
-1616.36933164074 |
-1616.36933164073 |
1225 |
10 |
-1627.72592876782 |
-1627.72592876782 |
-1627.7259287676 |
1225 |
11 |
-1635.34792942569 |
-1635.34792942569 |
-1635.34792942083 |
1225 |
12 |
-1593.96220766738 |
-1593.96220766738 |
-1593.96220766751 |
1225 |
13 |
-1605.59169980594 |
-1605.59169980594 |
-1605.59169980598 |
1225 |
14 |
-1644.84149893838 |
-1644.84149893838 |
-1644.8414989383 |
1225 |
15 |
-1647.00059441476 |
-1647.00059441476 |
-1647.00059441476 |
1225 |
16 |
-1630.66047552115 |
-1630.66047552115 |
-1630.66047552103 |
1225 |
17 |
-1620.53057020136 |
-1620.53057020136 |
-1620.53057020183 |
1225 |
18 |
-1586.64467391028 |
-1586.64467391028 |
-1586.64467391032 |
1225 |
19 |
-1589.04043730396 |
-1589.04043730396 |
-1589.04043730396 |
1225 |
20 |
-1617.9599059186 |
-1617.9599059186 |
-1617.95990591858 |
1225 |
21 |
-1613.09876670621 |
-1613.09876670621 |
-1613.09876670621 |
1225 |
22 |
-1639.36265618172 |
-1639.36265618172 |
-1639.3626561817 |
1225 |
23 |
-1601.59002313228 |
-1601.59002313229 |
-1601.59002313213 |
1225 |
24 |
-1592.23174222516 |
-1592.23174222516 |
-1592.23174222514 |
1225 |
25 |
-1592.28774730397 |
-1592.28774730397 |
-1592.28774730394 |
Spin Glass Solver Benchmark¶
Spins |
Instance # |
Gurobi |
ILOG CPLEX |
COPT |
|---|---|---|---|---|
100 |
1 |
-133.68691271691 |
-133.68691271691 |
-133.686912716909 |
100 |
2 |
-118.353217550371 |
-118.353217550371 |
-118.353217550371 |
100 |
3 |
-135.198983365478 |
-135.198983365478 |
-135.198983365478 |
100 |
4 |
-128.277571256617 |
-128.277571256617 |
-128.277571256616 |
100 |
5 |
-121.576807578814 |
-121.576807578814 |
-121.576807578814 |
100 |
6 |
-130.675718256534 |
-130.675718256534 |
-130.675718256534 |
100 |
7 |
-122.025871463363 |
-122.025871463363 |
-122.025871463363 |
100 |
8 |
-130.384817944919 |
-130.384817944919 |
-130.384817944919 |
100 |
9 |
-145.514544599427 |
-145.514544599427 |
-145.514544599427 |
100 |
10 |
-140.550342433212 |
-140.550342433212 |
-140.550342433212 |
100 |
11 |
-120.889593277609 |
-120.889593277609 |
-120.889593277609 |
100 |
12 |
-124.589606773666 |
-124.589606773666 |
-124.589606773666 |
100 |
13 |
-139.944555807569 |
-139.944555807569 |
-139.944555807569 |
100 |
14 |
-116.887364010103 |
-116.887364010103 |
-116.887364010103 |
100 |
15 |
-138.37542859495 |
-138.37542859495 |
-138.37542859495 |
100 |
16 |
-132.255514179923 |
-132.255514179923 |
-132.255514179923 |
100 |
17 |
-131.951284240203 |
-131.951284240203 |
-131.951284240203 |
100 |
18 |
-130.86604635829 |
-130.86604635829 |
-130.86604635829 |
100 |
19 |
-132.894290309752 |
-132.894290309752 |
-132.894290309752 |
100 |
20 |
-128.591027189994 |
-128.591027189994 |
-128.591027189994 |
100 |
21 |
-141.436723727536 |
-141.436723727536 |
-141.436723727536 |
100 |
22 |
-127.993543436337 |
-127.993543436337 |
-127.993543436337 |
100 |
23 |
-134.085929677815 |
-134.085929677815 |
-134.085929677815 |
100 |
24 |
-123.940080453916 |
-123.940080453916 |
-123.940080453916 |
100 |
25 |
-128.310062259878 |
-128.310062259878 |
-128.310062259878 |
144 |
1 |
-191.35973714063 |
-191.35973714063 |
-191.35973714063 |
144 |
2 |
-180.637641166943 |
-180.637641166943 |
-180.637641166943 |
144 |
3 |
-189.242184571409 |
-189.242184571409 |
-189.242184571409 |
144 |
4 |
-186.1739156395 |
-186.1739156395 |
-186.173915639498 |
144 |
5 |
-184.224910198199 |
-184.224910198199 |
-184.224910198199 |
144 |
6 |
-181.134592693888 |
-181.134592693888 |
-181.134592693888 |
144 |
7 |
-183.199984763521 |
-183.199984763521 |
-183.199984763521 |
144 |
8 |
-183.708791481257 |
-183.708791481257 |
-183.708791481257 |
144 |
9 |
-195.299910395433 |
-195.299910395433 |
-195.299910395433 |
144 |
10 |
-189.024745975672 |
-189.024745975672 |
-189.024745975672 |
144 |
11 |
-176.960185718386 |
-176.960185718386 |
-176.960185718386 |
144 |
12 |
-181.403929849667 |
-181.403929849667 |
-181.403929849667 |
144 |
13 |
-206.94306041287 |
-206.94306041287 |
-206.94306041287 |
144 |
14 |
-179.010230060918 |
-179.010230060918 |
-179.010230060918 |
144 |
15 |
-202.882902209616 |
-202.882902209616 |
-202.882902209616 |
144 |
16 |
-182.294138651642 |
-182.294138651642 |
-182.294138651642 |
144 |
17 |
-183.845903045721 |
-183.845903045722 |
-183.845903045721 |
144 |
18 |
-193.920875887806 |
-193.920875887805 |
-193.920875887805 |
144 |
19 |
-193.331820331766 |
-193.331820331766 |
-193.331820331766 |
144 |
20 |
-179.442325553594 |
-179.442325553594 |
-179.442325553594 |
144 |
21 |
-191.501189370352 |
-191.501189370352 |
-191.501189370352 |
144 |
22 |
-190.63181892291 |
-190.63181892291 |
-190.63181892291 |
144 |
23 |
-204.763917724832 |
-204.763917724832 |
-204.763917724832 |
144 |
24 |
-183.709821061621 |
-183.709821061621 |
-183.709821061621 |
144 |
25 |
-177.731306326638 |
-177.731306326638 |
-177.731306326638 |
196 |
1 |
-259.475713917918 |
-259.475713917918 |
-259.475713917918 |
196 |
2 |
-243.838807505552 |
-243.838807505552 |
-243.838807505552 |
196 |
3 |
-269.108514168066 |
-269.108514168066 |
-269.108514168066 |
196 |
4 |
-269.399993022422 |
-269.399993022422 |
-269.399993022422 |
196 |
5 |
-255.177189871126 |
-255.177189871126 |
-255.177189871126 |
196 |
6 |
-252.514676632961 |
-252.514676632961 |
-252.514676632936 |
196 |
7 |
-245.570267176501 |
-245.570267176501 |
-245.570267176503 |
196 |
8 |
-249.527920581507 |
-249.527920581507 |
-249.527920581507 |
196 |
9 |
-263.688519884409 |
-263.688519884409 |
-263.688519884409 |
196 |
10 |
-256.572139061099 |
-256.5721390611 |
-256.5721390611 |
196 |
11 |
-239.927094416699 |
-239.927094416699 |
-239.927094416698 |
196 |
12 |
-255.252866128902 |
-255.252866128902 |
-255.252866128902 |
196 |
13 |
-265.149179953555 |
-265.149179953555 |
-265.149179953555 |
196 |
14 |
-243.291802264656 |
-243.291802264656 |
-243.291802264656 |
196 |
15 |
-272.823796457302 |
-272.823796457302 |
-272.823796457302 |
196 |
16 |
-259.265627749423 |
-259.265627749423 |
-259.265627749423 |
196 |
17 |
-234.360499118109 |
-234.360499118109 |
-234.360499118108 |
196 |
18 |
-264.648493245755 |
-264.648493245755 |
-264.648493245755 |
196 |
19 |
-260.558595193995 |
-260.558595193995 |
-260.558595193995 |
196 |
20 |
-246.830397873969 |
-246.830397873969 |
-246.830397873968 |
196 |
21 |
-258.779325731711 |
-258.779325731711 |
-258.779325731711 |
196 |
22 |
-253.668515069093 |
-253.668515069093 |
-253.66851506911 |
196 |
23 |
-270.581368489709 |
-270.58136848971 |
-270.581368489709 |
196 |
24 |
-250.051890815446 |
-250.051890815446 |
-250.051890815446 |
196 |
25 |
-252.004713522444 |
-252.004713522444 |
-252.004713522444 |
256 |
1 |
-332.007659360176 |
-332.007659360176 |
-332.007659360164 |
256 |
2 |
-329.031252539039 |
-329.031252539039 |
-329.031252539039 |
256 |
3 |
-345.157068953907 |
-345.157068953908 |
-345.157068953907 |
256 |
4 |
-350.096056346407 |
-350.096056346407 |
-350.096056346407 |
256 |
5 |
-327.862683188204 |
-327.862683188204 |
-327.862683188203 |
256 |
6 |
-328.686720588454 |
-328.686720588454 |
-328.686720588454 |
256 |
7 |
-322.152228867776 |
-322.152228867775 |
-322.152228867776 |
256 |
8 |
-328.793426821494 |
-328.793426821494 |
-328.793426821494 |
256 |
9 |
-345.924557583259 |
-345.924557583259 |
-345.924557583259 |
256 |
10 |
-334.504800199513 |
-334.504800199513 |
-334.504800199513 |
256 |
11 |
-309.178118916063 |
-309.178118916063 |
-309.178118916058 |
256 |
12 |
-333.822323503785 |
-333.822323503785 |
-333.822323503785 |
256 |
13 |
-338.318980634696 |
-338.318980634696 |
-338.318980634696 |
256 |
14 |
-315.881171837445 |
-315.881171837445 |
-315.881171837444 |
256 |
15 |
-338.028975827389 |
-338.028975827389 |
-338.028975827389 |
256 |
16 |
-339.233385628392 |
-339.233385628392 |
-339.233385628392 |
256 |
17 |
-310.826055118832 |
-310.826055118832 |
-310.826055118831 |
256 |
18 |
-328.391803679645 |
-328.391803679645 |
-328.391803679645 |
256 |
19 |
-334.965411968778 |
-334.965411968778 |
-334.965411968778 |
256 |
20 |
-328.777271234221 |
-328.777271234221 |
-328.777271234221 |
256 |
21 |
-339.163076740134 |
-339.163076740135 |
-339.163076740134 |
256 |
22 |
-334.462079867598 |
-334.462079867598 |
-334.462079867597 |
256 |
23 |
-355.66553486324 |
-355.66553486324 |
-355.66553486324 |
256 |
24 |
-318.52129024094 |
-318.52129024094 |
-318.52129024094 |
256 |
25 |
-330.147128287406 |
-330.147128287406 |
-330.147128287406 |
RL Benchmarks¶
These benchmarks were run on a [computer specifications].
The following RL methods were tested:MCPG - [version]
REINFORCE - [version]
ECO-DQN - [version]
S2V-DQN - [version]
iSCO - [version]
The recorded values under each RL method represent the best objective score found.
Edwards-Anderson RL Benchmark¶
Spins |
Seed |
MCPG |
VNA |
L2A |
|---|---|---|---|---|
100 |
1 |
-78.6503982543945 |
-78.6504016840063 |
-76.5018463134765 |
100 |
2 |
-67.1720581054687 |
-67.1720578692989 |
-62.0614700317382 |
100 |
3 |
-70.7777938842773 |
-70.777792159058 |
-70.7777862548828 |
100 |
4 |
-73.139289855957 |
-73.1392899585965 |
-71.8332977294921 |
100 |
5 |
-74.6212997436523 |
-74.621299992447 |
-73.2931442260742 |
100 |
6 |
-76.7191314697265 |
-76.7191304112367 |
-75.9941253662109 |
100 |
7 |
-73.3273010253906 |
-73.3272999525438 |
-72.8011932373046 |
100 |
8 |
-75.161880493164 |
-75.1618765307825 |
-75.05078125 |
100 |
9 |
-70.8505554199218 |
-70.850549950409 |
-69.3610229492187 |
100 |
10 |
-70.0870819091796 |
-70.0870798958614 |
-68.7425918579101 |
100 |
11 |
-71.286376953125 |
-71.2863777233201 |
-70.6174011230468 |
100 |
12 |
-72.0846405029296 |
-72.0846409531129 |
-71.4062194824218 |
100 |
13 |
-82.2392578125 |
-82.2392567506142 |
-82.2392578125 |
100 |
14 |
-70.332534790039 |
-70.3325321624979 |
-67.7892456054687 |
100 |
15 |
-74.0883636474609 |
-74.0883581197803 |
-70.6578521728515 |
100 |
16 |
-70.4026641845703 |
-70.4026605865973 |
-68.9757614135742 |
100 |
17 |
-70.0424041748046 |
-70.0424053108144 |
-69.1842880249023 |
100 |
18 |
-73.8514099121093 |
-73.8514085909191 |
-73.2455291748046 |
100 |
19 |
-80.0025787353515 |
-80.0025811196057 |
-77.6606292724609 |
100 |
20 |
-71.4689636230468 |
-71.4689600745589 |
-71.4689636230468 |
100 |
21 |
-75.3332977294921 |
-75.3332956142594 |
-74.5988616943359 |
100 |
22 |
-75.5343475341796 |
-75.5343469621385 |
-74.9927978515625 |
100 |
23 |
-73.4247665405273 |
-73.4247665687752 |
-72.6790542602539 |
100 |
24 |
-72.6150207519531 |
-72.6150190546339 |
-71.7459640502929 |
100 |
25 |
-70.9973907470703 |
-70.9973874229352 |
-70.4756469726562 |
400 |
1 |
-313.565307617187 |
-295.321057354256 |
-301.045227050781 |
400 |
2 |
-304.548645019531 |
-283.495431238967 |
-285.099884033203 |
400 |
3 |
-293.402648925781 |
-276.542551740395 |
-274.202667236328 |
400 |
4 |
-313.870239257812 |
-294.316170582786 |
-297.530883789062 |
400 |
5 |
-301.800170898437 |
-292.05871309409 |
-286.783508300781 |
400 |
6 |
-306.372009277343 |
-285.383695479579 |
-293.694580078125 |
400 |
7 |
-306.714904785156 |
-288.558639149606 |
-297.700988769531 |
400 |
8 |
-304.514892578125 |
-282.215684845153 |
-278.331420898437 |
400 |
9 |
-289.028533935546 |
-272.62949499214 |
-278.723266601562 |
400 |
10 |
-306.971435546875 |
-283.590201959524 |
-290.091613769531 |
400 |
11 |
-309.565368652343 |
-288.321480995606 |
-298.197052001953 |
400 |
12 |
-302.419555664062 |
-279.134440717422 |
-288.967193603515 |
400 |
13 |
-313.510437011718 |
-288.686952510325 |
-285.612518310546 |
400 |
14 |
-307.114166259765 |
-284.690878267853 |
-291.960571289062 |
400 |
15 |
-320.890930175781 |
-294.684234420818 |
-304.983978271484 |
400 |
16 |
-305.071746826171 |
-286.383923502735 |
-281.282165527343 |
400 |
17 |
-306.674072265625 |
-286.667830955524 |
-288.808532714843 |
400 |
18 |
-299.929748535156 |
-283.085574377304 |
-279.766387939453 |
400 |
19 |
-307.490814208984 |
-276.64319976595 |
-292.772674560546 |
400 |
20 |
-307.171722412109 |
-286.296520147551 |
-277.414825439453 |
400 |
21 |
-313.111999511718 |
-300.072637018592 |
-295.048706054687 |
400 |
22 |
-309.295806884765 |
-281.916371716453 |
-287.145874023437 |
400 |
23 |
-302.4560546875 |
-282.326590387097 |
-283.021118164062 |
400 |
24 |
-307.200744628906 |
-284.867074495328 |
-296.423461914062 |
400 |
25 |
-308.80224609375 |
-281.505140698479 |
-292.388793945312 |
1600 |
1 |
-1231.18969726562 |
nan |
nan |
1600 |
2 |
-1259.04602050781 |
nan |
nan |
1600 |
3 |
-1249.34692382812 |
nan |
nan |
1600 |
4 |
-1257.23510742187 |
nan |
nan |
1600 |
5 |
-1240.11279296875 |
nan |
nan |
1600 |
6 |
-1260.38818359375 |
nan |
nan |
1600 |
7 |
-1241.92272949218 |
nan |
nan |
1600 |
8 |
-1225.3837890625 |
nan |
nan |
1600 |
9 |
-1223.16174316406 |
nan |
nan |
1600 |
10 |
-1274.23474121093 |
nan |
nan |
1600 |
11 |
-1227.90075683593 |
nan |
nan |
1600 |
12 |
-1233.923828125 |
nan |
nan |
1600 |
13 |
-1245.3837890625 |
nan |
nan |
1600 |
14 |
-1219.1123046875 |
nan |
nan |
1600 |
15 |
-1226.35229492187 |
nan |
nan |
1600 |
16 |
-1224.42834472656 |
nan |
nan |
1600 |
17 |
-1239.11157226562 |
nan |
nan |
1600 |
18 |
-1222.22241210937 |
nan |
nan |
1600 |
19 |
-1208.73974609375 |
nan |
nan |
1600 |
20 |
-1247.87512207031 |
nan |
nan |
1600 |
21 |
-1241.84411621093 |
nan |
nan |
1600 |
22 |
-1247.0966796875 |
nan |
nan |
1600 |
23 |
-1243.39111328125 |
nan |
nan |
1600 |
24 |
-1244.658203125 |
nan |
nan |
1600 |
25 |
-1247.93041992187 |
nan |
nan |
Sherrington-Kirkpatrick RL Benchmark¶
Spins |
Seed |
MCPG |
VNA |
L2A |
|---|---|---|---|---|
100 |
1 |
-7.18781280517578 |
-7.19129388865126 |
-7.19129333496093 |
100 |
2 |
-7.3482322692871 |
-7.077296082196 |
-7.29412841796875 |
100 |
3 |
-7.22880411148071 |
-7.10047208260597 |
-7.18830261230468 |
100 |
4 |
-7.31271743774414 |
-7.10830056644738 |
-7.11955490112304 |
100 |
5 |
-7.20986032485961 |
-7.36267310349865 |
-7.36267395019531 |
100 |
6 |
-7.22981739044189 |
-7.35044990349697 |
-7.35045013427734 |
100 |
7 |
-7.50916290283203 |
-7.26080622595545 |
-7.26080627441406 |
100 |
8 |
-7.28387975692749 |
-7.74802759061445 |
-7.74802780151367 |
100 |
9 |
-7.10372924804687 |
-7.05840739193989 |
-7.20774841308593 |
100 |
10 |
-7.24114990234375 |
-6.94828803259559 |
-6.99981307983398 |
100 |
11 |
-7.06640338897705 |
-7.10666909021324 |
-7.12807159423828 |
100 |
12 |
-7.41567850112915 |
-6.99788386839041 |
-6.99788360595703 |
100 |
13 |
-7.08461380004882 |
-7.18897843676844 |
-7.18897857666015 |
100 |
14 |
-7.4033555984497 |
-7.27652747204443 |
-7.27652740478515 |
100 |
15 |
-7.39076375961303 |
-7.08084752138495 |
-7.08144073486328 |
100 |
16 |
-7.42196989059448 |
-7.45873892263584 |
-7.45873870849609 |
100 |
17 |
-7.29114532470703 |
-7.32925793493814 |
-7.32925796508789 |
100 |
18 |
-7.17434310913085 |
-7.14602885357849 |
-7.14602813720703 |
100 |
19 |
-7.17368698120117 |
-7.46660512141334 |
-7.46660537719726 |
100 |
20 |
-7.24066638946533 |
-7.16051933486561 |
-7.22999954223632 |
100 |
21 |
-7.06857442855835 |
-7.22322051148096 |
-7.22322082519531 |
100 |
22 |
-7.32618284225463 |
-7.35639010794833 |
-7.35638961791992 |
100 |
23 |
-7.07985305786132 |
-7.34433841009994 |
-7.34433822631836 |
100 |
24 |
-7.09565830230712 |
-7.0987505525414 |
-7.09875030517578 |
100 |
25 |
-7.23334503173828 |
-7.11200096948774 |
-7.11200103759765 |
Ising Chain RL Benchmark¶
Spins |
Seed |
MCPG |
VNA |
L2A |
|---|---|---|---|---|
32 |
1 |
-13.1617813110351 |
-13.161782446079478 |
-13.1617822647094 |
32 |
2 |
-11.8206062316894 |
-11.820607056249523 |
-11.8206071853637 |
32 |
3 |
-14.3412904739379 |
-14.341291432326551 |
-14.3412914276123 |
32 |
4 |
-16.4911479949951 |
-16.491148870101885 |
-16.4911479949951 |
32 |
5 |
-13.7570648193359 |
-13.757064958180477 |
-13.7570648193359 |
32 |
6 |
-17.5183219909667 |
-17.51832298441677 |
-17.5183219909667 |
32 |
7 |
-15.6124868392944 |
-15.612486820667643 |
-15.6124877929687 |
32 |
8 |
-15.1964273452758 |
-15.196427200559144 |
-15.1964273452758 |
32 |
9 |
-16.1056327819824 |
-16.105632378290274 |
-16.1056327819824 |
32 |
10 |
-16.1354961395263 |
-16.135495121569953 |
-16.1354942321777 |
32 |
11 |
-13.2706708908081 |
-13.27067172615085 |
-13.2706718444824 |
32 |
12 |
-14.860445022583 |
-14.86044415321384 |
-14.8559255599975 |
32 |
13 |
-15.825813293457 |
-15.825813129816268 |
-15.825813293457 |
32 |
14 |
-15.8597106933593 |
-15.859711455299582 |
-15.859712600708 |
32 |
15 |
-13.0710592269897 |
-13.071059391701082 |
-13.0710592269897 |
32 |
16 |
-13.0400466918945 |
-13.04004718360769 |
-13.0400466918945 |
32 |
17 |
-13.5260944366455 |
-13.526093921150999 |
-13.5260944366455 |
32 |
18 |
-17.0963287353515 |
-17.09632825784518 |
-17.0963287353515 |
32 |
19 |
-14.715705871582 |
-14.715705159172511 |
-14.7157049179077 |
32 |
20 |
-17.3876609802246 |
-17.38766140764801 |
-17.3876609802246 |
32 |
21 |
-14.1910753250122 |
-14.191076034397907 |
-14.1910753250122 |
32 |
22 |
-16.4035606384277 |
-16.403561153922574 |
-16.4035606384277 |
32 |
23 |
-15.6802062988281 |
-15.680206130729037 |
-15.6802062988281 |
32 |
24 |
-18.7985801696777 |
-18.79857855640515 |
-18.7985801696777 |
32 |
25 |
-14.2958602905273 |
-14.295860318456237 |
-14.2958602905273 |
64 |
1 |
-28.289794921875 |
-28.28979360403696 |
-28.2897930145263 |
64 |
2 |
-29.3904476165771 |
-29.39044755468203 |
-29.3904476165771 |
64 |
3 |
-29.4574966430664 |
-29.457496252308438 |
-29.3977451324462 |
64 |
4 |
-32.9461059570312 |
-32.94610772737576 |
-32.9461059570312 |
64 |
5 |
-31.3387260437011 |
-31.338727396597825 |
-31.3387260437011 |
64 |
6 |
-35.8099098205566 |
-35.80990951538015 |
-35.8099060058593 |
64 |
7 |
-31.477237701416 |
-31.477238246743113 |
-31.477237701416 |
64 |
8 |
-31.4722995758056 |
-31.472301733396968 |
-31.4082851409912 |
64 |
9 |
-32.588565826416 |
-32.58856547379827 |
-32.588565826416 |
64 |
10 |
-32.4342422485351 |
-32.43424366654636 |
-32.4342422485351 |
64 |
11 |
-29.7679405212402 |
-29.76793960225338 |
-29.726972579956 |
64 |
12 |
-29.7771320343017 |
-29.777131542975148 |
-29.4063758850097 |
64 |
13 |
-30.2073802947998 |
-30.207378904046777 |
-30.0715179443359 |
64 |
14 |
-30.6526317596435 |
-30.652633826206603 |
-30.6526336669921 |
64 |
15 |
-26.2433471679687 |
-26.243344872634868 |
-26.2433452606201 |
64 |
16 |
-28.4118461608886 |
-28.41184733074173 |
-28.4118461608886 |
64 |
17 |
-30.616153717041 |
-30.61615141205099 |
-30.513765335083 |
64 |
18 |
-32.155158996582 |
-32.155158618574625 |
-32.1005249023437 |
64 |
19 |
-31.745491027832 |
-31.74548773245731 |
-31.7454872131347 |
64 |
20 |
-33.12158203125 |
-33.1215838422734 |
-33.12158203125 |
64 |
21 |
-33.4069595336914 |
-33.40695953768379 |
-33.4069595336914 |
64 |
22 |
-30.1303062438964 |
-30.130306627739504 |
-30.1303062438964 |
64 |
23 |
-31.7161903381347 |
-31.71619314507435 |
-31.7161922454834 |
64 |
24 |
-37.5729179382324 |
-37.5729175856893 |
-37.5729179382324 |
64 |
25 |
-31.8505706787109 |
-31.850569340242952 |
-31.7816696166992 |
128 |
1 |
-62.3954200744628 |
-62.395420355113735 |
-62.3637809753418 |
128 |
2 |
-59.4799003601074 |
-59.47990232592067 |
-58.8280792236328 |
128 |
3 |
-61.799934387207 |
-61.799936330258944 |
-61.799934387207 |
128 |
4 |
-67.0629272460937 |
-67.06292451537986 |
-67.0629196166992 |
128 |
5 |
-65.108169555664 |
-65.10817196906144 |
-65.108169555664 |
128 |
6 |
-65.1005554199218 |
-65.10055314827221 |
-65.1005554199218 |
128 |
7 |
-64.3395233154296 |
-64.33952622745284 |
-63.4517440795898 |
128 |
8 |
-65.3801879882812 |
-65.38018958178529 |
-65.3801879882812 |
128 |
9 |
-61.8794631958007 |
-61.87945958952775 |
-61.8794631958007 |
128 |
10 |
-60.1466789245605 |
-60.146679163623226 |
-60.1466789245605 |
128 |
11 |
-64.6454467773437 |
-64.64544397539223 |
-64.6454467773437 |
128 |
12 |
-63.1399726867675 |
-63.13997626907928 |
-63.0754432678222 |
128 |
13 |
-59.467601776123 |
-59.467602778526235 |
-59.0596542358398 |
128 |
14 |
-59.6891632080078 |
-59.68916499021308 |
-59.689167022705 |
128 |
15 |
-58.8594512939453 |
-58.85945106660996 |
-58.5763397216796 |
128 |
16 |
-63.365436553955 |
-63.36543677181659 |
-63.3654403686523 |
128 |
17 |
-65.5746307373046 |
-65.57463470020375 |
-65.5746307373046 |
128 |
18 |
-64.0116729736328 |
-64.01167204410854 |
-63.3758392333984 |
128 |
19 |
-66.6478805541992 |
-66.64787681642571 |
-65.7371673583984 |
128 |
20 |
-65.8171157836914 |
-65.8171174478803 |
-65.8171234130859 |
128 |
21 |
-66.2257385253906 |
-66.22573301858898 |
-66.2257385253906 |
128 |
22 |
-62.9514999389648 |
-62.951501584695436 |
-62.9515075683593 |
128 |
23 |
-62.1408462524414 |
-62.14084533098089 |
-62.0106964111328 |
128 |
24 |
-68.3932342529296 |
-68.39323028705472 |
-68.3932342529296 |
128 |
25 |
-60.6364059448242 |
-60.636408870316956 |
-60.6364097595214 |
Wishart-Planted Ensemble RL Benchmark¶
2-D Spin Glass RL Benchmark¶
Spins |
Instance # |
MCPG |
VNA |
L2A |
|---|---|---|---|---|
400 |
1 |
-518.68408203125 |
-496.570892346537 |
-478.28091430664 |
400 |
2 |
-555.264282226562 |
-521.333864339926 |
-523.171264648437 |
400 |
3 |
-534.827026367187 |
-511.084959917283 |
-501.092010498046 |
400 |
4 |
-527.901123046875 |
-504.847752281775 |
-487.096557617187 |
400 |
5 |
-529.746520996093 |
-511.732121044417 |
-497.092834472656 |
400 |
6 |
-544.877990722656 |
-529.416733698985 |
-523.989135742187 |
400 |
7 |
-551.628051757812 |
-536.743526814091 |
-510.487518310546 |
400 |
8 |
-548.313842773437 |
-526.749526998982 |
-500.040344238281 |
400 |
9 |
-495.579284667968 |
-482.133200498719 |
-468.840942382812 |
400 |
10 |
-534.849487304687 |
-512.064573557183 |
-501.278259277343 |
400 |
11 |
-535.871826171875 |
-513.206120623651 |
-483.181030273437 |
400 |
12 |
-515.443176269531 |
-485.284828495097 |
-478.923828125 |
400 |
13 |
-546.995727539062 |
-530.195107165789 |
-520.334594726562 |
400 |
14 |
-492.62939453125 |
-473.956164454565 |
-464.557891845703 |
400 |
15 |
-531.634094238281 |
-516.659985269512 |
-496.407287597656 |
400 |
16 |
-514.261474609375 |
-492.311187802697 |
-473.533599853515 |
400 |
17 |
-519.914916992187 |
-497.021546207731 |
-494.992218017578 |
400 |
18 |
-542.552673339843 |
-509.57116231951 |
-490.169952392578 |
400 |
19 |
-549.427429199218 |
-520.710120800409 |
-518.558715820312 |
400 |
20 |
-519.329040527343 |
-487.872678522148 |
-490.132690429687 |
400 |
21 |
-529.342651367187 |
-509.57781767923 |
-494.38052368164 |
400 |
22 |
-496.457336425781 |
-475.047646261984 |
-450.062072753906 |
400 |
23 |
-550.0703125 |
-523.851441647391 |
-521.480651855468 |
400 |
24 |
-533.11572265625 |
-509.215922366382 |
-491.874206542968 |
625 |
1 |
-830.986572265625 |
-780.379732305622 |
-759.419555664062 |
625 |
2 |
-819.382385253906 |
-775.224393072669 |
-735.220947265625 |
625 |
3 |
-847.472045898437 |
-799.629164105686 |
-789.884826660156 |
625 |
4 |
-800.71923828125 |
-768.782665932068 |
-731.4453125 |
625 |
5 |
-828.94091796875 |
-790.022541815161 |
-747.93994140625 |
625 |
6 |
-793.323303222656 |
-751.594949093147 |
-718.959350585937 |
625 |
7 |
-846.029052734375 |
-807.143428923361 |
-784.511352539062 |
625 |
8 |
-823.684204101562 |
-775.57106528321 |
-765.039916992187 |
625 |
9 |
-838.367919921875 |
-784.84184495694 |
-748.217712402343 |
625 |
10 |
-793.523742675781 |
-753.390738496076 |
-739.593139648437 |
625 |
11 |
-818.02978515625 |
-774.289043840644 |
-736.121826171875 |
625 |
12 |
-838.5048828125 |
-801.791148677037 |
-769.58203125 |
625 |
13 |
-810.745239257812 |
-766.24878664283 |
-740.314453125 |
625 |
14 |
-810.262939453125 |
-769.954492160694 |
-741.384887695312 |
625 |
15 |
-869.717163085937 |
-811.934739984899 |
-772.830688476562 |
625 |
16 |
-813.742858886718 |
-765.402593936793 |
-725.513305664062 |
625 |
17 |
-806.944580078125 |
-756.445197484638 |
-734.956115722656 |
625 |
18 |
-841.579711914062 |
-785.029742791983 |
-768.583618164062 |
625 |
19 |
-830.823791503906 |
-787.313577368885 |
-766.013854980468 |
625 |
20 |
-831.333618164062 |
-776.785055844344 |
-750.064086914062 |
625 |
21 |
-780.798156738281 |
-731.307801107345 |
-707.085327148437 |
625 |
22 |
-835.737915039062 |
-779.648750458788 |
-765.423828125 |
625 |
23 |
-817.007019042968 |
-777.981858851152 |
-756.716796875 |
625 |
24 |
-831.108032226562 |
-787.220779902051 |
-750.825561523437 |
625 |
25 |
-817.573791503906 |
-767.845653360759 |
-761.313049316406 |
900 |
1 |
-1170.77697753906 |
-1117.52397645709 |
-1087.77111816406 |
900 |
2 |
-1153.77075195312 |
-1113.48640797915 |
-1050.92407226562 |
900 |
3 |
-1173.63049316406 |
-1119.15026347046 |
-1039.65209960937 |
900 |
4 |
-1220.73474121093 |
-1168.32460876659 |
-1105.12451171875 |
900 |
5 |
-1184.298828125 |
-1124.59977872349 |
-1050.22021484375 |
900 |
6 |
-1164.78125 |
-1097.5235344489 |
-1061.63391113281 |
900 |
7 |
-1167.13940429687 |
-1106.05342341424 |
-1043.19458007812 |
900 |
8 |
-1201.29565429687 |
-1157.2600423307 |
-1121.46643066406 |
900 |
9 |
-1176.30895996093 |
-1116.92194910173 |
-1090.90014648437 |
900 |
10 |
-1178.42541503906 |
-1121.81283127254 |
-1056.36547851562 |
900 |
11 |
-1191.42224121093 |
-1136.41808855782 |
-1070.48950195312 |
900 |
12 |
-1185.64868164062 |
-1137.21983803928 |
-1101.08923339843 |
900 |
13 |
-1221.88244628906 |
-1180.32421700501 |
-1099.25512695312 |
900 |
14 |
-1171.64135742187 |
-1114.86165360538 |
-1072.77783203125 |
900 |
15 |
-1182.54748535156 |
-1121.19389307424 |
-1067.52294921875 |
900 |
16 |
-1171.06420898437 |
-1119.02934317182 |
-1056.72802734375 |
900 |
17 |
-1171.83471679687 |
-1130.98318775813 |
-1064.09350585937 |
900 |
18 |
-1152.17626953125 |
-1106.40804328639 |
-1044.36499023437 |
900 |
19 |
-1164.32775878906 |
-1115.56769419425 |
-1056.17407226562 |
900 |
20 |
-1240.5693359375 |
-1180.73328927177 |
-1132.46606445312 |
900 |
21 |
-1159.755859375 |
-1103.68328859873 |
-1023.3798828125 |
900 |
22 |
-1186.08850097656 |
-1135.68359892941 |
-1088.7568359375 |
900 |
23 |
-1149.80737304687 |
-1105.41773208016 |
-1038.97717285156 |
900 |
24 |
-1183.23693847656 |
-1138.15626381189 |
-1055.41479492187 |
900 |
25 |
-1199.33605957031 |
-1153.61957104567 |
nan |
1225 |
1 |
-1575.87060546875 |
-1500.07459135773 |
nan |
1225 |
2 |
-1598.79895019531 |
-1536.2459812246 |
nan |
1225 |
3 |
-1579.13940429687 |
nan |
nan |
1225 |
4 |
-1604.18469238281 |
nan |
nan |
1225 |
5 |
-1598.99755859375 |
nan |
nan |
1225 |
6 |
-1573.79870605468 |
nan |
nan |
1225 |
7 |
-1628.751953125 |
nan |
nan |
1225 |
8 |
-1606.58093261718 |
nan |
nan |
1225 |
9 |
-1612.53430175781 |
nan |
nan |
1225 |
10 |
nan |
nan |
nan |
1225 |
11 |
nan |
nan |
nan |
1225 |
12 |
nan |
nan |
nan |
1225 |
13 |
nan |
nan |
nan |
1225 |
14 |
nan |
nan |
nan |
1225 |
15 |
nan |
nan |
nan |
1225 |
16 |
nan |
nan |
nan |
1225 |
17 |
nan |
nan |
nan |
1225 |
18 |
nan |
nan |
nan |
1225 |
19 |
nan |
nan |
nan |
1225 |
20 |
nan |
nan |
nan |
1225 |
21 |
nan |
nan |
nan |
1225 |
22 |
nan |
nan |
nan |
1225 |
23 |
nan |
nan |
nan |
1225 |
24 |
nan |
nan |
nan |
1225 |
25 |
nan |
nan |
nan |
Spin Glass RL Benchmark¶
Spins |
Instance # |
MCPG |
VNA |
L2A |
|---|---|---|---|---|
100 |
1 |
-133.686920166015 |
-133.6869127169102 |
-131.287689208984 |
100 |
2 |
-118.353225708007 |
-118.35321755037177 |
-117.13816833496 |
100 |
3 |
-135.198989868164 |
-135.19898336547845 |
-133.178741455078 |
100 |
4 |
-128.277572631835 |
-128.2775712566175 |
-128.277557373046 |
100 |
5 |
-121.57681274414 |
-121.57680757881445 |
-120.750122070312 |
100 |
6 |
-130.675720214843 |
-128.39185876206412 |
-127.195236206054 |
100 |
7 |
-122.02587890625 |
-122.02587146336322 |
-120.745651245117 |
100 |
8 |
-130.384826660156 |
-130.38481794491895 |
-128.899581909179 |
100 |
9 |
-145.514556884765 |
-144.19980861264256 |
-142.026000976562 |
100 |
10 |
-140.550338745117 |
-140.55034243321288 |
-140.550338745117 |
100 |
11 |
-120.889602661132 |
-120.8895932776095 |
-118.894088745117 |
100 |
12 |
-124.589607238769 |
-124.58960677366693 |
-123.324493408203 |
100 |
13 |
-139.944564819335 |
-139.94455580756983 |
-137.967300415039 |
100 |
14 |
-116.88735961914 |
-116.88736401010301 |
-116.454399108886 |
100 |
15 |
-138.375442504882 |
-138.3754285949508 |
-135.075805664062 |
100 |
16 |
-132.25552368164 |
-132.2555141799233 |
-130.868225097656 |
100 |
17 |
-131.951293945312 |
-131.9512842402034 |
-131.951293945312 |
100 |
18 |
-130.86604309082 |
-130.86604635829042 |
-124.49323272705 |
100 |
19 |
-132.894287109375 |
-132.8942903097527 |
-131.686920166015 |
100 |
20 |
-128.591033935546 |
-126.17240997749818 |
-128.591033935546 |
100 |
21 |
-141.436737060546 |
-141.43672372753676 |
-141.089263916015 |
100 |
22 |
-127.993553161621 |
-127.99354343633708 |
-121.5009765625 |
100 |
23 |
-134.08592224121 |
-134.08592967781544 |
-134.08592224121 |
100 |
24 |
-123.940086364746 |
-122.78124564151241 |
-118.209609985351 |
100 |
25 |
nan |
-128.31006225987852 |
nan |
144 |
1 |
-191.359741210937 |
-185.51171264386028 |
-181.532623291015 |
144 |
2 |
-180.637664794921 |
-179.42702545946727 |
-176.92333984375 |
144 |
3 |
-189.2421875 |
-184.0651426296209 |
-185.485748291015 |
144 |
4 |
-186.173919677734 |
-181.0384547571223 |
-183.569641113281 |
144 |
5 |
-184.224914550781 |
-181.8097393733213 |
-179.28807067871 |
144 |
6 |
-181.13459777832 |
-179.01942412162245 |
-173.991928100585 |
144 |
7 |
-183.199981689453 |
-181.86051751197763 |
-177.994934082031 |
144 |
8 |
-183.708786010742 |
-180.8830228477012 |
-177.01187133789 |
144 |
9 |
-195.299926757812 |
-187.87385719966758 |
-190.707702636718 |
144 |
10 |
-189.024749755859 |
-185.04116089854986 |
-182.931457519531 |
144 |
11 |
-176.960189819335 |
-176.71215072397612 |
-170.895629882812 |
144 |
12 |
-181.403945922851 |
-178.79295819849614 |
-180.185668945312 |
144 |
13 |
-206.943084716796 |
-200.14140822882905 |
-204.330825805664 |
144 |
14 |
-179.01023864746 |
-174.95368679054437 |
-176.592208862304 |
144 |
15 |
-202.882919311523 |
-202.14443054698577 |
-196.76040649414 |
144 |
16 |
-182.294143676757 |
-177.56126081495304 |
-180.602294921875 |
144 |
17 |
-183.845901489257 |
-179.86351734635502 |
-173.418853759765 |
144 |
18 |
-193.92088317871 |
-191.4765778663929 |
-192.27326965332 |
144 |
19 |
-193.331848144531 |
-191.02374305010653 |
-188.326950073242 |
144 |
20 |
-179.442321777343 |
-174.76853460330943 |
-173.386795043945 |
144 |
21 |
-191.501190185546 |
-189.36065197734322 |
-185.906661987304 |
144 |
22 |
-190.63182067871 |
-185.55194682424303 |
-180.05271911621 |
144 |
23 |
-204.763916015625 |
-198.51029923822347 |
-201.517883300781 |
144 |
24 |
-183.709823608398 |
-178.05170882937767 |
-179.781799316406 |
144 |
25 |
-177.731292724609 |
-175.4543113953108 |
-174.921478271484 |
196 |
1 |
-259.475708007812 |
-237.879309181589 |
-248.42495727539 |
196 |
2 |
-243.838821411132 |
-232.041253694771 |
-232.202606201171 |
196 |
3 |
-269.10855102539 |
-246.299297863273 |
-262.504852294921 |
196 |
4 |
-269.399993896484 |
-257.979941679133 |
-254.193084716796 |
196 |
5 |
-255.177215576171 |
-241.39233009098 |
-250.530654907226 |
196 |
6 |
-252.514678955078 |
-236.188438085966 |
-240.695495605468 |
196 |
7 |
-245.570281982421 |
-220.484852355467 |
-239.967224121093 |
196 |
8 |
-249.527923583984 |
-218.31154306947 |
-237.281997680664 |
196 |
9 |
-263.688537597656 |
-245.579208549883 |
-257.633666992187 |
196 |
10 |
-256.572143554687 |
-238.054101830347 |
-249.829284667968 |
196 |
11 |
-239.927093505859 |
-226.555992174029 |
-229.171508789062 |
196 |
12 |
-255.252868652343 |
-228.212594211174 |
-251.113464355468 |
196 |
13 |
-265.149200439453 |
-236.734014956137 |
-250.166427612304 |
196 |
14 |
-243.291793823242 |
-223.288253537151 |
-236.198364257812 |
196 |
15 |
-272.823791503906 |
-240.729198792449 |
-258.096923828125 |
196 |
16 |
-259.265625 |
-227.071689303485 |
-255.166046142578 |
196 |
17 |
-234.36050415039 |
-225.587029294334 |
-220.754333496093 |
196 |
18 |
-264.648498535156 |
-234.377211714126 |
-259.153137207031 |
196 |
19 |
-260.55859375 |
-236.101423067435 |
-247.46987915039 |
196 |
20 |
-246.83039855957 |
-231.881398201616 |
-241.944046020507 |
196 |
21 |
-258.779327392578 |
-241.350398687004 |
-243.22557067871 |
196 |
22 |
-253.668518066406 |
-236.117505777371 |
-242.248596191406 |
196 |
23 |
-270.581359863281 |
-252.7098906447 |
-256.293395996093 |
196 |
24 |
-250.05191040039 |
-235.459635637051 |
-238.298217773437 |
196 |
25 |
-252.004699707031 |
-237.187014206623 |
-235.167938232421 |
256 |
1 |
-332.007690429687 |
-307.166566730898 |
-312.077209472656 |
256 |
2 |
-329.03125 |
-301.894450850053 |
-308.942108154296 |
256 |
3 |
-345.157073974609 |
-324.058134052204 |
-322.369934082031 |
256 |
4 |
-350.096069335937 |
-310.860596577664 |
-333.902191162109 |
256 |
5 |
-327.862701416015 |
-295.850774339972 |
-312.182586669921 |
256 |
6 |
-328.686737060546 |
-298.975377081741 |
-317.199890136718 |
256 |
7 |
-322.152252197265 |
-301.457034853592 |
-310.7529296875 |
256 |
8 |
-328.79345703125 |
-298.823910662101 |
-318.845520019531 |
256 |
9 |
-345.924560546875 |
-313.373719852575 |
-314.9443359375 |
256 |
10 |
-334.504791259765 |
-313.294149250928 |
-317.838409423828 |
256 |
11 |
-309.178131103515 |
-288.034270620356 |
-299.749267578125 |
256 |
12 |
-333.822326660156 |
-299.392223801823 |
-319.519653320312 |
256 |
13 |
-338.318969726562 |
-314.291421245124 |
-300.120056152343 |
256 |
14 |
-315.881195068359 |
-284.724699300373 |
-294.060607910156 |
256 |
15 |
-338.028991699218 |
-320.512945353938 |
-317.365234375 |
256 |
16 |
-339.2333984375 |
-321.192273683916 |
-319.286682128906 |
256 |
17 |
-310.826080322265 |
-286.954968263033 |
-301.120452880859 |
256 |
18 |
-328.391845703125 |
-302.09326871378 |
-316.304626464843 |
256 |
19 |
-334.965393066406 |
-305.6866961694 |
-328.731536865234 |
256 |
20 |
-328.777282714843 |
-294.615723507421 |
-317.153533935546 |
256 |
21 |
-339.1630859375 |
-321.576525164246 |
-330.278350830078 |
256 |
22 |
-334.462097167968 |
-300.776079727627 |
-322.70947265625 |
256 |
23 |
-355.66552734375 |
-330.371650211288 |
-338.706237792968 |
256 |
24 |
-318.521301269531 |
-297.416451844469 |
-301.373748779296 |
256 |
25 |
-330.147155761718 |
-308.211809085413 |
-319.366577148437 |
Fully Connected SK Benchmark¶
Spins |
Instance # |
MCPG |
VNA |
L2A |
|---|---|---|---|---|
100 |
1 |
nan |
-71.50815590802017 |
nan |
100 |
2 |
nan |
-71.12963498467343 |
nan |
100 |
3 |
nan |
-74.33866097062491 |
nan |
100 |
4 |
nan |
-70.52826780189571 |
nan |
100 |
5 |
nan |
-71.27579161651556 |
nan |
100 |
6 |
nan |
-74.72190655157829 |
nan |
100 |
7 |
nan |
-75.10542125326538 |
nan |
100 |
8 |
nan |
-75.81244770251647 |
nan |
100 |
9 |
nan |
-71.17556665328448 |
nan |
100 |
10 |
nan |
-71.74692461196173 |
nan |
100 |
11 |
nan |
-76.97346178213684 |
nan |
100 |
12 |
nan |
-69.66110817496156 |
nan |
100 |
13 |
nan |
-73.07749597372094 |
nan |
100 |
14 |
nan |
-71.51472866218683 |
nan |
100 |
15 |
nan |
-74.94395674328916 |
nan |
100 |
16 |
nan |
-73.31599086980714 |
nan |
100 |
17 |
nan |
-70.0741413502426 |
nan |
100 |
18 |
nan |
-74.13425884020035 |
nan |
100 |
19 |
nan |
-73.19217600479169 |
nan |
100 |
20 |
nan |
-73.52385727337605 |
nan |
100 |
21 |
nan |
-75.279814387628 |
nan |
100 |
22 |
nan |
-69.79291583482882 |
nan |
100 |
23 |
nan |
-73.20002658403064 |
nan |
100 |
24 |
nan |
-76.77983476668851 |
nan |
100 |
25 |
nan |
-72.94357982144413 |
nan |
Fully Connected WPE Benchmark¶
Spins |
Instance # |
MCPG |
VNA |
L2A |
|---|---|---|---|---|
0.25 |
1 |
nan |
-3.8165322595 |
nan |
0.25 |
2 |
nan |
-3.8911290334 |
nan |
0.25 |
3 |
nan |
-3.9889112923 |
nan |
0.25 |
4 |
nan |
-3.9135584694 |
nan |
0.25 |
5 |
nan |
-4.050403228 |
nan |
0.25 |
6 |
nan |
-3.8508064533 |
nan |
0.25 |
7 |
nan |
-3.9838709668 |
nan |
0.25 |
8 |
nan |
-3.9435483891 |
nan |
0.25 |
9 |
nan |
-3.9647177436 |
nan |
0.25 |
10 |
nan |
-3.9034778244 |
nan |
0.25 |
11 |
nan |
-3.7862903242 |
nan |
0.25 |
12 |
nan |
-3.9637096779 |
nan |
0.25 |
13 |
nan |
-3.9627016145 |
nan |
0.25 |
14 |
nan |
-3.9979838729 |
nan |
0.25 |
15 |
nan |
-3.8518145177 |
nan |
0.25 |
16 |
nan |
-3.9243951623 |
nan |
0.25 |
17 |
nan |
-3.8802923402 |
nan |
0.25 |
18 |
nan |
-3.7593245987 |
nan |
0.25 |
19 |
nan |
-3.8651713721 |
nan |
0.25 |
20 |
nan |
-4.0181451593 |
nan |
0.25 |
21 |
nan |
-3.8014112907 |
nan |
0.25 |
22 |
nan |
-3.9168346790 |
nan |
0.25 |
23 |
nan |
-3.8876008084 |
nan |
0.25 |
24 |
nan |
-3.9392641151 |
nan |
0.25 |
25 |
nan |
-3.9072580659 |
nan |
0.50 |
1 |
nan |
-7.7016129035 |
nan |
0.50 |
2 |
nan |
-7.9334677414 |
nan |
0.50 |
3 |
nan |
-7.6794354844 |
nan |
0.50 |
4 |
nan |
-7.9818548388 |
nan |
0.50 |
5 |
nan |
-7.5751008067 |
nan |
0.50 |
6 |
nan |
-7.6444052415 |
nan |
0.50 |
7 |
nan |
-8.1088709675 |
nan |
0.50 |
8 |
nan |
-8.0000000009 |
nan |
0.50 |
9 |
nan |
-8.0826612908 |
nan |
0.50 |
10 |
nan |
-8.1209677422 |
nan |
0.50 |
11 |
nan |
-7.8709677403 |
nan |
0.50 |
12 |
nan |
-7.9213709678 |
nan |
0.50 |
13 |
nan |
-8.0141129043 |
nan |
0.50 |
14 |
nan |
-7.7691532258 |
nan |
0.50 |
15 |
nan |
-7.929435484 |
nan |
0.50 |
16 |
nan |
-7.9072580645 |
nan |
0.50 |
17 |
nan |
-7.7802419352 |
nan |
0.50 |
18 |
nan |
-8.1169354843 |
nan |
0.50 |
19 |
nan |
-7.4415322579 |
nan |
0.50 |
20 |
nan |
-7.7318548389 |
nan |
0.50 |
21 |
nan |
-7.9455645158 |
nan |
0.50 |
22 |
nan |
-7.713961693 |
nan |
0.50 |
23 |
nan |
-7.6736391136 |
nan |
0.50 |
24 |
nan |
-7.8104838709 |
nan |
0.50 |
25 |
nan |
-7.9233870958 |
nan |
0.50 |
1 |
nan |
-7.7016129035 |
nan |
0.50 |
2 |
nan |
-7.9334677414 |
nan |
0.50 |
3 |
nan |
-7.6794354844 |
nan |
0.50 |
4 |
nan |
-7.9818548388 |
nan |
0.50 |
5 |
nan |
-7.5751008067 |
nan |
0.50 |
6 |
nan |
-7.6444052415 |
nan |
0.50 |
7 |
nan |
-8.1088709675 |
nan |
0.50 |
8 |
nan |
-8.0000000009 |
nan |
0.50 |
9 |
nan |
-8.0826612908 |
nan |
0.50 |
10 |
nan |
-8.1209677422 |
nan |
0.50 |
11 |
nan |
-7.8709677403 |
nan |
0.50 |
12 |
nan |
-7.9213709678 |
nan |
0.50 |
13 |
nan |
-8.0141129043 |
nan |
0.50 |
14 |
nan |
-7.7691532258 |
nan |
0.50 |
15 |
nan |
-7.929435484 |
nan |
0.50 |
16 |
nan |
-7.9072580645 |
nan |
0.50 |
17 |
nan |
-7.7802419352 |
nan |
0.50 |
18 |
nan |
-8.1169354843 |
nan |
0.50 |
19 |
nan |
-7.4415322579 |
nan |
0.50 |
20 |
nan |
-7.7318548389 |
nan |
0.50 |
21 |
nan |
-7.9455645158 |
nan |
0.50 |
22 |
nan |
-7.713961693 |
nan |
0.50 |
23 |
nan |
-7.6736391136 |
nan |
0.50 |
24 |
nan |
-7.8104838709 |
nan |
0.50 |
25 |
nan |
-7.9233870958 |
nan |
0.75 |
1 |
nan |
-12.0826612905 |
nan |
0.75 |
2 |
nan |
-12.074596775 |
nan |
0.75 |
3 |
nan |
-12.1975806452 |
nan |
0.75 |
4 |
nan |
-11.7479838718 |
nan |
0.75 |
5 |
nan |
-12.0584677424 |
nan |
0.75 |
6 |
nan |
-11.7762096763 |
nan |
0.75 |
7 |
nan |
-12.1310483869 |
nan |
0.75 |
8 |
nan |
-11.9798387098 |
nan |
0.75 |
9 |
nan |
-11.9576612915 |
nan |
0.75 |
10 |
nan |
-11.9697580656 |
nan |
0.75 |
11 |
nan |
-11.8588709676 |
nan |
0.75 |
12 |
nan |
-11.949596774 |
nan |
0.75 |
13 |
nan |
-12.0161290324 |
nan |
0.75 |
14 |
nan |
-12.0040322584 |
nan |
0.75 |
15 |
nan |
-11.8447580646 |
nan |
0.75 |
16 |
nan |
-12.0766129029 |
nan |
0.75 |
17 |
nan |
-12.0907258071 |
nan |
0.75 |
18 |
nan |
-12.0080645156 |
nan |
0.75 |
19 |
nan |
-11.9979838708 |
nan |
0.75 |
20 |
nan |
-12.1310483862 |
nan |
0.75 |
21 |
nan |
-12.1370967743 |
nan |
0.75 |
22 |
nan |
-11.9959677428 |
nan |
0.75 |
23 |
nan |
-12.0685483869 |
nan |
0.75 |
24 |
nan |
-12.1612903229 |
nan |
0.75 |
25 |
nan |
-11.8427419363 |
nan |
1.00 |
1 |
nan |
-15.8689516121 |
nan |
1.00 |
2 |
nan |
-15.8205645156 |
nan |
1.00 |
3 |
nan |
-15.8387096782 |
nan |
1.00 |
4 |
nan |
-15.8266129032 |
nan |
1.00 |
5 |
nan |
-16.0443548386 |
nan |
1.00 |
6 |
nan |
-16.0141129028 |
nan |
1.00 |
7 |
nan |
-15.8548387108 |
nan |
1.00 |
8 |
nan |
-16.1451612904 |
nan |
1.00 |
9 |
nan |
-16.0584677406 |
nan |
1.00 |
10 |
nan |
-15.7721774194 |
nan |
1.00 |
11 |
nan |
-16.0282258068 |
nan |
1.00 |
12 |
nan |
-15.778225805 |
nan |
1.00 |
13 |
nan |
-16.1088709677 |
nan |
1.00 |
14 |
nan |
-16.0947580643 |
nan |
1.00 |
15 |
nan |
-16.0504032268 |
nan |
1.00 |
16 |
nan |
-16.0060483862 |
nan |
1.00 |
17 |
nan |
-15.9133064522 |
nan |
1.00 |
18 |
nan |
-15.9435483868 |
nan |
1.00 |
19 |
nan |
-15.6895161298 |
nan |
1.00 |
20 |
nan |
-16.0544354834 |
nan |
1.00 |
21 |
nan |
-16.0342741933 |
nan |
1.00 |
22 |
nan |
-15.9334677404 |
nan |
1.00 |
23 |
nan |
-16.108870968 |
nan |
1.00 |
24 |
nan |
-15.9737903233 |
nan |
1.00 |
25 |
nan |
-16.1129032253 |
nan |
1.25 |
1 |
nan |
-20.1895161285 |
nan |
1.25 |
2 |
nan |
-19.8528225805 |
nan |
1.25 |
3 |
nan |
-19.8931451618 |
nan |
1.25 |
4 |
nan |
-20.1250000002 |
nan |
1.25 |
5 |
nan |
-20.1068548375 |
nan |
1.25 |
6 |
nan |
-19.5403225817 |
nan |
1.25 |
7 |
nan |
-20.2862903237 |
nan |
1.25 |
8 |
nan |
-19.8689516126 |
nan |
1.25 |
9 |
nan |
-19.8266129022 |
nan |
1.25 |
10 |
nan |
-20.1471774196 |
nan |
1.25 |
11 |
nan |
-19.9516129029 |
nan |
1.25 |
12 |
nan |
-19.9838709675 |
nan |
1.25 |
13 |
nan |
-20.0967741932 |
nan |
1.25 |
14 |
nan |
-20.1693548389 |
nan |
1.25 |
15 |
nan |
-20.1451612912 |
nan |
1.25 |
16 |
nan |
-19.8891129036 |
nan |
1.25 |
17 |
nan |
-19.8770161289 |
nan |
1.25 |
18 |
nan |
-19.9556451615 |
nan |
1.25 |
19 |
nan |
-19.9637096777 |
nan |
1.25 |
20 |
nan |
-19.762096774 |
nan |
1.25 |
21 |
nan |
-20.217741935 |
nan |
1.25 |
22 |
nan |
-20.0967741928 |
nan |
1.25 |
23 |
nan |
-19.9536290325 |
nan |
1.25 |
24 |
nan |
-20.0524193543 |
nan |
1.25 |
25 |
nan |
-20.078629033 |
nan |
1.50 |
1 |
nan |
-23.9213709676 |
nan |
1.50 |
2 |
nan |
-23.9717741929 |
nan |
1.50 |
3 |
nan |
-24.1330645159 |
nan |
1.50 |
4 |
nan |
-24.0342741937 |
nan |
1.50 |
5 |
nan |
-24.0947580643 |
nan |
1.50 |
6 |
nan |
-24.1108870966 |
nan |
1.50 |
7 |
nan |
-24.0080645155 |
nan |
1.50 |
8 |
nan |
-24.1068548391 |
nan |
1.50 |
9 |
nan |
-24.1048387096 |
nan |
1.50 |
10 |
nan |
-23.9012096778 |
nan |
1.50 |
11 |
nan |
-23.8991935484 |
nan |
1.50 |
12 |
nan |
-24.0181451614 |
nan |
1.50 |
13 |
nan |
-23.9596774195 |
nan |
1.50 |
14 |
nan |
-23.8346774187 |
nan |
1.50 |
15 |
nan |
-24.2197580653 |
nan |
1.50 |
16 |
nan |
-24.0443548376 |
nan |
1.50 |
17 |
nan |
-24.0645161291 |
nan |
1.50 |
18 |
nan |
-23.9737903232 |
nan |
1.50 |
19 |
nan |
-23.9939516131 |
nan |
1.50 |
20 |
nan |
-23.8528225812 |
nan |
1.50 |
21 |
nan |
-23.9536290318 |
nan |
1.50 |
22 |
nan |
-23.9879032249 |
nan |
1.50 |
23 |
nan |
-24.0987903224 |
nan |
1.50 |
24 |
nan |
-23.8870967742 |
nan |
1.50 |
25 |
nan |
-23.8790322586 |
nan |
Biclique BCQS Benchmark¶
Spins |
Instance # |
MCPG |
VNA |
L2A |
|---|---|---|---|---|
20 |
1 |
nan |
-26.42919921875 |
nan |
20 |
2 |
nan |
-26.42919921875 |
nan |
20 |
3 |
nan |
-25.9908447265625 |
nan |
20 |
4 |
nan |
-26.20654296875 |
nan |
20 |
5 |
nan |
-28.140869140625 |
nan |
20 |
6 |
nan |
-27.26416015625 |
nan |
20 |
7 |
nan |
-27.65380859375 |
nan |
20 |
8 |
nan |
-27.4520263671875 |
nan |
20 |
9 |
nan |
-28.126953125 |
nan |
20 |
10 |
nan |
-28.1199951171875 |
nan |
20 |
11 |
nan |
-27.6190185546875 |
nan |
20 |
12 |
nan |
-26.9510498046875 |
nan |
20 |
13 |
nan |
-27.34765625 |
nan |
20 |
14 |
nan |
-28.0782470703125 |
nan |
20 |
15 |
nan |
-28.586181640625 |
nan |
20 |
16 |
nan |
-30.4718017578125 |
nan |
20 |
17 |
nan |
-24.828857421875 |
nan |
20 |
18 |
nan |
-28.9549560546875 |
nan |
20 |
19 |
nan |
-26.65185546875 |
nan |
20 |
20 |
nan |
-26.81884765625 |
nan |
24 |
1 |
nan |
-33.51690673828125 |
nan |
24 |
2 |
nan |
-33.82452392578125 |
nan |
24 |
3 |
nan |
-33.02984619140625 |
nan |
24 |
4 |
nan |
-32.60687255859375 |
nan |
24 |
5 |
nan |
-34.47821044921875 |
nan |
24 |
6 |
nan |
-32.79913330078125 |
nan |
24 |
7 |
nan |
-32.52996826171875 |
nan |
24 |
8 |
nan |
-32.0621337890625 |
nan |
24 |
9 |
nan |
-33.83734130859375 |
nan |
24 |
10 |
nan |
-35.17034912109375 |
nan |
24 |
11 |
nan |
-36.2149658203125 |
nan |
24 |
12 |
nan |
-31.99163818359375 |
nan |
24 |
13 |
nan |
-31.99163818359375 |
nan |
24 |
14 |
nan |
-33.22210693359375 |
nan |
24 |
15 |
nan |
-31.818603515625 |
nan |
24 |
16 |
nan |
-33.305419921875 |
nan |
24 |
17 |
nan |
31.587890625 |
nan |
24 |
18 |
nan |
-33.63226318359375 |
nan |
24 |
19 |
nan |
-34.5230712890625 |
nan |
24 |
20 |
nan |
-31.96600341796875 |
nan |
28 |
1 |
nan |
-40.41510009765625 |
nan |
28 |
2 |
nan |
-39.1895751953125 |
nan |
28 |
3 |
nan |
-39.9473876953125 |
nan |
28 |
4 |
nan |
-38.3370361328125 |
nan |
28 |
5 |
nan |
-41.52813720703125 |
nan |
28 |
6 |
nan |
-39.6868896484375 |
nan |
28 |
7 |
nan |
-37.7923583984375 |
nan |
28 |
8 |
nan |
-38.89947509765625 |
nan |
28 |
9 |
nan |
-38.78106689453125 |
nan |
28 |
10 |
nan |
-38.97052001953125 |
nan |
28 |
11 |
nan |
-37.9581298828125 |
nan |
28 |
12 |
nan |
-38.17718505859375 |
nan |
28 |
13 |
nan |
-39.31982421875 |
nan |
28 |
14 |
nan |
-39.40863037109375 |
nan |
28 |
15 |
nan |
-37.38385009765625 |
nan |
28 |
16 |
nan |
-39.627685546875 |
nan |
28 |
17 |
nan |
-38.1357421875 |
nan |
28 |
18 |
nan |
-37.591064453125 |
nan |
28 |
19 |
nan |
-37.9107666015625 |
nan |
28 |
20 |
nan |
37.44305419921875 |
nan |
32 |
1 |
nan |
-44.3858642578125 |
nan |
32 |
2 |
nan |
-45.58001708984375 |
nan |
32 |
3 |
nan |
-44.2969970703125 |
nan |
32 |
4 |
nan |
-44.74688720703125 |
nan |
32 |
5 |
nan |
-46.152099609375 |
nan |
32 |
6 |
nan |
-44.1414794921875 |
nan |
32 |
7 |
nan |
-44.05816650390625 |
nan |
32 |
8 |
nan |
-43.397216796875 |
nan |
32 |
9 |
nan |
-44.952392578125 |
nan |
32 |
10 |
nan |
-43.5860595703125 |
nan |
32 |
11 |
nan |
-45.55224609375 |
nan |
32 |
12 |
nan |
-44.73577880859375 |
nan |
32 |
13 |
nan |
-46.5631103515625 |
nan |
32 |
14 |
nan |
-44.57470703125 |
nan |
32 |
15 |
nan |
-42.98065185546875 |
nan |
32 |
16 |
nan |
-46.0521240234375 |
nan |
32 |
17 |
nan |
-43.76934814453125 |
nan |
32 |
18 |
nan |
-45.58001708984375 |
nan |
32 |
19 |
nan |
-44.13592529296875 |
nan |
32 |
20 |
nan |
-42.71405029296875 |
nan |
36 |
1 |
nan |
-49.5821533203125 |
nan |
36 |
2 |
nan |
-51.3564453125 |
nan |
36 |
3 |
nan |
-51.460205078125 |
nan |
36 |
4 |
nan |
-51.90118408203125 |
nan |
36 |
5 |
nan |
-51.50689697265625 |
nan |
36 |
6 |
nan |
-51.045166015625 |
nan |
36 |
7 |
nan |
-49.43170166015625 |
nan |
36 |
8 |
nan |
-48.6275634765625 |
nan |
36 |
9 |
nan |
-49.6859130859375 |
nan |
36 |
10 |
nan |
-49.73260498046875 |
nan |
36 |
11 |
nan |
-51.9893798828125 |
nan |
36 |
12 |
nan |
-50.37591552734375 |
nan |
36 |
13 |
nan |
-50.5159912109375 |
nan |
36 |
14 |
nan |
-50.0802001953125 |
nan |
36 |
15 |
nan |
-50.65606689453125 |
nan |
36 |
16 |
nan |
-50.94659423828125 |
nan |
36 |
17 |
nan |
-49.00628662109375 |
nan |
36 |
18 |
nan |
-51.9478759765625 |
nan |
36 |
19 |
nan |
-50.00238037109375 |
nan |
36 |
20 |
nan |
-50.007568359375 |
nan |
3D BCQS Benchmark¶
Spins |
Instance # |
MCPG |
VNA |
L2A |
|---|---|---|---|---|
18 |
1 |
nan |
-10.546875 |
nan |
18 |
2 |
nan |
-11.328125 |
nan |
18 |
3 |
nan |
-10.09375 |
nan |
18 |
4 |
nan |
-11.90625 |
nan |
18 |
5 |
nan |
-11.09375 |
nan |
18 |
6 |
nan |
-11.5 |
nan |
18 |
7 |
nan |
-10.265625 |
nan |
18 |
8 |
nan |
-11.109375 |
nan |
18 |
9 |
nan |
-13.203125 |
nan |
18 |
10 |
nan |
-12.4609375 |
nan |
18 |
11 |
nan |
-10.4140625 |
nan |
18 |
12 |
nan |
-9.890625 |
nan |
18 |
13 |
nan |
-13.3125 |
nan |
18 |
14 |
nan |
-11.734375 |
nan |
18 |
15 |
nan |
-9.9453125 |
nan |
18 |
16 |
nan |
-10.71875 |
nan |
18 |
17 |
nan |
-9.0859375 |
nan |
18 |
18 |
nan |
-12.3984375 |
nan |
18 |
19 |
nan |
-10.1875 |
nan |
18 |
20 |
nan |
-11.71875 |
nan |
32 |
1 |
nan |
nan |
nan |
32 |
2 |
nan |
nan |
nan |
32 |
3 |
nan |
nan |
nan |
32 |
4 |
nan |
nan |
nan |
32 |
5 |
nan |
nan |
nan |
32 |
6 |
nan |
nan |
nan |
32 |
7 |
nan |
nan |
nan |
32 |
8 |
nan |
nan |
nan |
32 |
9 |
nan |
nan |
nan |
32 |
10 |
nan |
nan |
nan |
32 |
11 |
nan |
nan |
nan |
32 |
12 |
nan |
nan |
nan |
32 |
13 |
nan |
nan |
nan |
32 |
14 |
nan |
nan |
nan |
32 |
15 |
nan |
nan |
nan |
32 |
16 |
nan |
nan |
nan |
32 |
17 |
nan |
nan |
nan |
32 |
18 |
nan |
nan |
nan |
32 |
19 |
nan |
nan |
nan |
32 |
20 |
nan |
nan |
nan |
50 |
1 |
nan |
nan |
nan |
50 |
2 |
nan |
nan |
nan |
50 |
3 |
nan |
nan |
nan |
50 |
4 |
nan |
nan |
nan |
50 |
5 |
nan |
nan |
nan |
50 |
6 |
nan |
nan |
nan |
50 |
7 |
nan |
nan |
nan |
50 |
8 |
nan |
nan |
nan |
50 |
9 |
nan |
nan |
nan |
50 |
10 |
nan |
nan |
nan |
50 |
11 |
nan |
nan |
nan |
50 |
12 |
nan |
nan |
nan |
50 |
13 |
nan |
nan |
nan |
50 |
14 |
nan |
nan |
nan |
50 |
15 |
nan |
nan |
nan |
50 |
16 |
nan |
nan |
nan |
50 |
17 |
nan |
nan |
nan |
50 |
18 |
nan |
nan |
nan |
50 |
19 |
nan |
nan |
nan |
50 |
20 |
nan |
nan |
nan |
Physics Benchmarks¶
These benchmarks were run on a [computer specifications].
The following physics methods were tested:VCA - [version]
The recorded values under each physics method represent the best objective score found.
Spin Glass Physics Benchmark¶
Instance |
VCA |
|---|---|
Spin Ice Physics Benchmark¶
Instance |
VCA |
|---|---|
Ferromagnetic Physics Benchmark¶
Instance |
VCA |
|---|---|
Anti-Ferromagnetic Physics Benchmark¶
Instance |
VCA |
|---|---|