Cutechess

SPRT

Command:

cutechess-cli \
  -engine cmd=littlewing-v0.2.0-v0.2.0-42-gc10106a-fix-attacks \
  -engine cmd=littlewing-v0.2.0-v0.2.0-42-gc10106a: \
  -each proto=xboard tc=40/10+0.1 \
  -openings file=2moves.pgn -repeat -rounds 10000 \
  -sprt elo0=0 elo1=5 alpha=0.05 beta=0.05 \
  -concurrency $(nproc) -pgnout games.pgn 

Result:

Score of Little Wing v0.2.0-42-gc10106a-fix-attacks vs Little Wing v0.2.0-42-gc10106a: 466 - 344 - 150  [0.564] 960
Elo difference: 44.39 +/- 20.32
SPRT: llr 1.97, lbound -2.94, ubound 2.94
Finished match

Tournament

Command:

cutechess-cli \
  -engine cmd=/usr/local/bin/littlewing proto=xboard \
  -engine cmd=/usr/local/bin/sjaak proto=xboard \
  -engine cmd=/usr/local/bin/sayuri proto=uci \
  -engine cmd=/usr/local/bin/pigeon proto=uci \
  -each tc=40/10+0.1 \
  -openings file=2moves.pgn -repeat -rounds 10000 -recover -wait 10 \
  -concurrency $(nproc) -pgnout games.pgn -ratinginterval 10

Result:

Rank Name                              Elo     +/-   Games   Score   Draws
   1 Sjaak 524                         190      10    5208   75.0%   15.1%
   2 Little Wing v0.3.0-18-g441470e     33       9    5208   54.7%   16.2%
   3 Sayuri 2017.09.29                -105       9    5209   35.3%   15.9%
   4 Pigeon 1.5.1                     -107       8    5207   35.0%   25.1%

Bayeselo

Command:

echo -e "prompt off\nreadpgn games.pgn\nelo\nmm\nratings\n" | bayeselo

Result:

Rank Name                                      Elo    +    - games score oppo. draws 
   1 Sjaak 524                                 143    6    6 11124   74%   -54   15% 
   2 Little Wing v0.3.0-18-g441470e             22    8    8  5208   55%   -13   16% 
   3 Little Wing v0.3.0-19-g4b2c53e-parallel    16    7    7  5917   54%   -13   16% 
   4 Pigeon 1.5.1                              -89    5    5 11122   35%    23   25% 
   5 Sayuri 2017.09.29                         -92    6    6 11127   36%    24   16%