ProDeo 2.1

A new way and a break with the past.

What previous tries already indicated there is ELO in big data and perhaps more I thought at first sight. In the first YAT edition ProDeo 2.0 scored an 78 ELO improvement with as only change a computer generated extended opening book made from CCRL and CEGT games of about 9 million positions, about 100 Mb uncompressed, see 2016.cht in the BOOKS directory.


While 78 ELO is probably a bit overrated (and the next edition of YAT will tell more) it further awakened my curiosity to invest more time and energy in computer generated ELO and as such I started the *.EBF project. ProDeo 2.1 now supports the new *.EBF format and part of the analysis is included and will be further updated.

Big Data in Action

Click to enlarge

If you are the owner of ChessPartner then you can watch how the various opening book systems smoothly work together via the engine -> tutor window.


A short 40/60 1000 game match ended in favor of the new EBF format with 53.7% indicating an 25 ELO increase from the 2275 produced book hits. More below.

Moves played from Programmable Book :    0
Moves played from Tournament Book   :    0
Moves played from Main Book         :    0
Moves played from EBF Book          : 2275
Moves played from CHT Book          :    0

MEANING


That if there is so much ELO in this unexplored area I prefer ProDeo 2.1 (and on) to be tested as released. It's the same 2.0 engine anyway. As such I have made some changes, the standard opening book is hardwired, book learning also, you can't turn it off, the permanent brain command by the GUI is ignored as well, for serious testing I want to play the thing as its best possible and not crippled removing opening books and learning facilities on rating lists.


And as such I want to give a signal too:

 There is ELO in big data.


Programmers immediately can profit from the large 2016.cht (extended) opening book in the BOOKS folder by implementing the *.CHT source code as introduced in Prodeo 1.84.


Programmers can profit from the *.EBF project by implementing the *.EBF source code and download the upcoming *.EBF extended opening books.


____________________________________________________________________________________________________


Download and installation

ProDeo 2.1 (Winboard and UCI compatible) which you can run in multiple Interrfaces, among them the freeware Arena.


To run ProDeo you will need to announce the engine first.

Approx 66 Mb


    U
nder Chessbase this means: Engine -> New UCI engine -> Browse -> RebelUCI.exe



Under ARENA do: Engines -> New Engine -> UCI -> RebelUCI.exe


Under ChessPartner do: Extra -> Engine Import Wizard -> Winboard -> Install -> ProDeo.exe

______________________________________________________________________________________



For demonstration purposes we pitch ProDeo 2.0 and 2.1 (they have the same engine) against each other playing short 40/60 1000 game matches and measure the ELO progress of *.EBF books.


Results

so far

Match

Positions

Analysis depth

Book hits

Result

ELO

2016.ebf

432.359

PLY=16

2.275

53.7%

+25

2016.ebf

705.723

PLY=18

2.681

55.9%

+40

2016.ebf

1.159.138

PLY=20

3.150

56.2%

+42

2016.ebf

1.773.146

PLY=22

3.412

56.3%

+43

2.561.183

PLY=24

3.516

55.2%

+35

2016.ebf

analysis stalled because of YAT2

PLY=26




2016.ebf


PLY=28




2016.ebf


PLY=30




Download the the newest available 2016.ebf and extract it into BOOKS folder. All positions are analysed with Stockfish 7 at 2 seconds per move. The PLY=16 version is included in the ProDeo 2.1 download.


____________________________________________________________________________________________________


Next table combines 2016.ebf and 2016.cht

Results so far

Match

Positions

Analysis depth

Book hits

Result

ELO

2016.cht [ only ]

8.6 million

PLY=60

3.575

58.0%

+55







cht + ebf

9.3 million

PLY=18

3.954

58.6%

+60

cht + ebf

9.7 million

PLY=20

4.142

57.3%

+51

cht + ebf

10.3 million

PLY=22

4.277

57.2%

+50

cht + ebf

11.1 million

PLY=24

4.224

56.3%

+44

cht + ebf


PLY=26




cht + ebf


PLY=28




cht + ebf


PLY=30




____________________________________________________________________________________________________


Parameters


CHT and EBF books are controlled by parameters as found in the personal/prodeo.eng configuration file.


[EBF File = books\2016.ebf]     * database location

[EBF Depth = 30]                    * consult EBF database till 15 moves


[EBF Priority = CHT]                * EBF | CHT


[CHT File = books\2016.cht]     * database location

[CHT Use = all]                       * human | comp | all | none

[CHT Priority = comp]              * human | comp

[CHT Depth = 60]                   * consult CHT database till 30 moves


For the meaning of the CHT parameters we refer to Prodeo 1.84.


The [EBF Priority = ] parameter decides which book should be used as first one. For the moment the CHT book performs better and thus the CHT setting is used. When a move is found in the CHT book it is played, if nothing is found it will consult the EBF book. Using the setting EBF will reverse the search order.

Follow us at Facebook for the latest developments.