MattBench

MattBench Testing Framework

Finished
Ellie	sable	main	diff	40.0+0.40	Elo: 63.69 +- 13.13 (95%) [N=1000] Games: 1004 W: 388 L: 206 D: 410 Ptnml(0-2): 4, 64, 218, 178, 38
Ellie	sable	runestone-net-arch	diff	40.0+0.40	LLR: 3.00 (-2.25, 2.89) [0.00, 5.00] Games: 1600 W: 562 L: 425 D: 613 Ptnml(0-2): 17, 148, 358, 235, 42
Ellie	sable	runestone-net-arch	diff	8.0+0.08	LLR: 3.63 (-2.25, 2.89) [0.00, 5.00] Games: 2802 W: 967 L: 781 D: 1054 Ptnml(0-2): 58, 277, 599, 355, 112
Ellie	sable	bespoke-vex	diff	2.0+0.02	LLR: 3.54 (-2.25, 2.89) [-5.00, 0.00] Games: 7844 W: 3168 L: 3003 D: 1673 Ptnml(0-2): 567, 590, 1465, 711, 589
Ellie	sable	bespoke-vex	diff	2.0+0.02	LLR: -2.60 (-2.25, 2.89) [0.00, 3.00] Games: 27868 W: 10059 L: 10205 D: 7604 Ptnml(0-2): 1665, 2600, 5471, 2612, 1586
Tecci	Cherry	more-cutnode-lmr	diff	8.0+0.08	LLR: -2.28 (-2.25, 2.89) [0.00, 3.00] Games: 8344 W: 1907 L: 2026 D: 4411 Ptnml(0-2): 41, 1042, 2114, 945, 30
Ellie	sable	moar-simd	diff	2.0+0.02	LLR: 3.06 (-2.25, 2.89) [0.00, 3.00] Games: 15996 W: 6186 L: 5824 D: 3986 Ptnml(0-2): 1010, 1462, 2867, 1474, 1185
Ellie	sable	vex-iteration-4	diff	120.0+1.20	LLR: -1.99 (-2.25, 2.89) [0.00, 5.00] Games: 12494 W: 3566 L: 3594 D: 5334 Ptnml(0-2): 158, 1487, 2976, 1477, 149
Ellie	sable	vex-iteration-4	diff	40.0+0.40	LLR: -2.31 (-2.25, 2.89) [0.00, 5.00] Games: 19082 W: 5501 L: 5515 D: 8066 Ptnml(0-2): 301, 2338, 4286, 2306, 310
Ellie	sable	vex-iteration-4	diff	8.0+0.08	LLR: -2.59 (-2.25, 2.89) [0.00, 5.00] Games: 6430 W: 1948 L: 2040 D: 2442 Ptnml(0-2): 197, 782, 1348, 692, 196
Tecci	Cherry	double-negext	diff	40.0+0.40	LLR: -2.27 (-2.25, 2.89) [0.00, 3.00] Games: 28186 W: 6338 L: 6408 D: 15440 Ptnml(0-2): 18, 3416, 7298, 3340, 21
Ellie	sable	uncapped-tactical-evasions	diff	40.0+0.40	LLR: -2.30 (-2.25, 2.89) [0.00, 5.00] Games: 8694 W: 2308 L: 2365 D: 4021 Ptnml(0-2): 102, 1100, 2014, 1015, 116
Ellie	sable	followup-history	diff	40.0+0.40	LLR: -2.29 (-2.25, 2.89) [0.00, 3.00] Games: 8182 W: 2188 L: 2328 D: 3666 Ptnml(0-2): 138, 1050, 1837, 946, 120
Tecci	Cherry	updog	diff	80.0+0.80	LLR: -1.80 (-2.25, 2.89) [0.00, 3.00] Games: 11540 W: 2594 L: 2671 D: 6275 Ptnml(0-2): 3, 1383, 3076, 1304, 4
Ellie	sable	followup-history	diff	8.0+0.08	LLR: -2.38 (-2.25, 2.89) [0.00, 5.00] Games: 9294 W: 2677 L: 2741 D: 3876 Ptnml(0-2): 221, 1117, 2022, 1079, 208
Ellie	sable	followup-history	diff	8.0+0.08	LLR: -2.50 (-2.25, 2.89) [0.00, 5.00] Games: 2628 W: 719 L: 819 D: 1090 Ptnml(0-2): 70, 345, 560, 293, 46
Dan	Hobbes	C1B7DCCC039ADDDC	diff	N=12000	Generated 5000018/5000000 Games Elo: 0.05 +- 0.25 (95%) [N=5000000] Games: 5000018 W: 1619474 L: 1618743 D: 1761801
Noctur	Heimdall	bad-noisy-fp	diff	40.0+0.40	LLR: -0.15 (-2.25, 2.89) [0.00, 3.00] Games: 144 W: 30 L: 39 D: 75 Ptnml(0-2): 0, 25, 31, 16, 0
Noctur	Heimdall	bad-noisy-fp	diff	8.0+0.08	LLR: 0.09 (-2.25, 2.89) [0.00, 3.00] Games: 1140 W: 282 L: 274 D: 584 Ptnml(0-2): 5, 131, 290, 139, 5
Tecci	Cherry	updog	diff	40.0+0.40	LLR: -1.91 (-2.25, 2.89) [0.00, 3.00] Games: 16300 W: 3645 L: 3719 D: 8936 Ptnml(0-2): 15, 1954, 4282, 1888, 11
Ellie	sable	main *	diff	N=5000	Generated 2501670/2500000 Games Elo: 0.39 +- 0.40 (95%) [N=2500000] Games: 2501670 W: 1107436 L: 1104595 D: 289639
Ellie	sable	main *	diff	N=5000	Generated 2501716/2500000 Games Elo: -0.05 +- 0.41 (95%) [N=2500000] Games: 2501716 W: 1108458 L: 1108853 D: 284405
Sp00ph	icarus	fract-hist-lmr	diff	8.0+0.08	LLR: -3.05 (-2.94, 2.94) [0.00, 4.00] Games: 4100 W: 922 L: 1053 D: 2125 Ptnml(0-2): 24, 565, 1007, 426, 28
Ellie	sable	tt-adjusted-eval-two	diff	40.0+0.40	LLR: -2.31 (-2.25, 2.89) [0.00, 5.00] Games: 3404 W: 938 L: 1020 D: 1446 Ptnml(0-2): 61, 426, 796, 372, 47
Ellie	sable	tt-adjusted-eval-two	diff	8.0+0.08	LLR: -2.62 (-2.25, 2.89) [0.00, 5.00] Games: 1468 W: 378 L: 493 D: 597 Ptnml(0-2): 54, 200, 313, 141, 26

1 2 3 4 5 6 251 252 253