MattBench

MattBench Testing Framework

Finished
Liamt	AwesomeOpossum	packed_nodes_again	diff	8.0+0.08	LLR: -0.64 (-2.25, 2.89) [-5.00, 0.00] Games: 1866 W: 622 L: 659 D: 585 Ptnml(0-2): 61, 167, 500, 158, 47
Liamt	AwesomeOpossum	packed_nodes_again	diff	8.0+0.08	LLR: -2.32 (-2.25, 2.89) [-5.00, 0.00] Games: 1026 W: 298 L: 409 D: 319 Ptnml(0-2): 49, 118, 256, 75, 15
Liamt	AwesomeOpossum	packed_nodes_again	diff	8.0+0.08	LLR: -2.26 (-2.25, 2.89) [-5.00, 0.00] Games: 3158 W: 1021 L: 1139 D: 998 Ptnml(0-2): 110, 331, 782, 279, 77
Liamt	AwesomeOpossum	opv-012-smol-kld-v2	diff	N=75000	LLR: -0.36 (-2.25, 2.89) [0.00, 3.00] Games: 830 W: 328 L: 361 D: 141 Ptnml(0-2): 67, 63, 181, 44, 60
Liamt	Horsie	tsoj_adaptive_lmr_thing	diff	8.0+0.08	LLR: -2.26 (-2.25, 2.89) [0.00, 3.00] Games: 19940 W: 4507 L: 4595 D: 10838 Ptnml(0-2): 38, 2411, 5149, 2345, 27
Liamt	AwesomeOpossum	opv-012-smol-kld	diff	8.0+0.08	LLR: -0.60 (-2.25, 2.89) [0.00, 5.00] Games: 2444 W: 908 L: 927 D: 609 Ptnml(0-2): 132, 236, 498, 231, 125
Liamt	AwesomeOpossum	opv-012-smol-kld	diff	N=75000	LLR: -2.33 (-2.25, 2.89) [0.00, 5.00] Games: 2044 W: 777 L: 901 D: 366 Ptnml(0-2): 168, 163, 436, 135, 120
Liamt	AwesomeOpossum	redo_bindings	diff	N=100000	Elo: 0.07 +- 0.14 (95%) [N=5000] Games: 5042 W: 1851 L: 1850 D: 1341 Ptnml(0-2): 0, 0, 2520, 1, 0
Liamt	AwesomeOpossum	single_persp_value	diff	8.0+0.08	LLR: 0.91 (-2.25, 2.89) [0.00, 5.00] Games: 2530 W: 982 L: 918 D: 630 Ptnml(0-2): 127, 224, 516, 254, 144
Liamt	AwesomeOpossum	redo_bindings	diff	8.0+0.08	LLR: 0.48 (-2.25, 2.89) [0.00, 5.00] Games: 1332 W: 476 L: 449 D: 407 Ptnml(0-2): 32, 112, 366, 109, 47
Liamt	AwesomeOpossum	opp-011-v1 *	diff	8.0+0.08	LLR: 2.91 (-2.25, 2.89) [0.00, 5.00] Games: 3232 W: 1242 L: 1062 D: 928 Ptnml(0-2): 145, 297, 613, 355, 206
Liamt	AwesomeOpossum	opp-011-data-test *	diff	8.0+0.08	LLR: -0.25 (-2.25, 2.89) [0.00, 5.00] Games: 4234 W: 1537 L: 1526 D: 1171 Ptnml(0-2): 260, 403, 781, 412, 261
Liamt	AwesomeOpossum	opp-011-v1	diff	N=100000	LLR: 2.90 (-2.25, 2.89) [0.00, 5.00] Games: 2286 W: 949 L: 775 D: 562 Ptnml(0-2): 106, 170, 460, 258, 149
Liamt	AwesomeOpossum	opp-011-v1 *	diff	N=100000	LLR: 2.90 (-2.25, 2.89) [0.00, 5.00] Games: 1390 W: 612 L: 429 D: 349 Ptnml(0-2): 63, 109, 234, 160, 129
Liamt	AwesomeOpossum	opp-011-data-test	diff	8.0+0.08	LLR: -1.80 (-2.25, 2.89) [0.00, 5.00] Games: 11578 W: 4011 L: 4042 D: 3525 Ptnml(0-2): 489, 1227, 2389, 1194, 490
Liamt	AwesomeOpossum	opp-011-data-test *	diff	8.0+0.08	LLR: -0.83 (-2.25, 2.89) [0.00, 3.00] Games: 1440 W: 492 L: 566 D: 382 Ptnml(0-2): 98, 158, 255, 138, 71
Liamt	AwesomeOpossum	opp-011-data-test	diff	8.0+0.08	LLR: -1.13 (-2.25, 2.89) [0.00, 3.00] Games: 1784 W: 573 L: 661 D: 550 Ptnml(0-2): 89, 180, 406, 164, 53
Liamt	AwesomeOpossum	opp-011-data-test	diff	8.0+0.08	LLR: 0.00 (-2.25, 2.89) [0.00, 5.00] Games: 0 W: 0 L: 0 D: 0 Ptnml(0-2): 0, 0, 0, 0, 0
Liamt	AwesomeOpossum	policy_128_quant	diff	N=100000	LLR: -1.31 (-2.25, 2.89) [0.00, 3.00] Games: 10714 W: 4025 L: 4104 D: 2585 Ptnml(0-2): 533, 945, 2455, 916, 508
Liamt	Horsie	opossum_opv-010-v3 *	diff	8.0+0.08	Elo: -1199.83 +- 98.31 (95%) [N=2000] Games: 842 W: 0 L: 841 D: 1 Ptnml(0-2): 420, 1, 0, 0, 0
Liamt	AwesomeOpossum	opp-010-v2	diff	40.0+0.40	LLR: 2.92 (-2.25, 2.89) [0.00, 5.00] Games: 1046 W: 409 L: 262 D: 375 Ptnml(0-2): 15, 83, 218, 154, 53
Liamt	AwesomeOpossum	opp-010	diff	N=100000	LLR: 2.95 (-2.25, 2.89) [0.00, 5.00] Games: 1798 W: 773 L: 601 D: 424 Ptnml(0-2): 74, 121, 391, 185, 128
Liamt	AwesomeOpossum	opp-010	diff	8.0+0.08	LLR: 2.97 (-2.25, 2.89) [0.00, 5.00] Games: 1226 W: 510 L: 344 D: 372 Ptnml(0-2): 31, 106, 227, 164, 85
Liamt	AwesomeOpossum	u8_mailbox	diff	N=100000	LLR: -0.21 (-2.25, 2.89) [0.00, 3.00] Games: 2880 W: 1073 L: 1073 D: 734 Ptnml(0-2): 0, 0, 1440, 0, 0
Liamt	AwesomeOpossum	yeet_mailbox	diff	N=100000	LLR: -0.37 (-2.25, 2.89) [0.00, 3.00] Games: 5040 W: 1868 L: 1868 D: 1304 Ptnml(0-2): 0, 0, 2520, 0, 0

1 2 3