go_attack icon indicating copy to clipboard operation
go_attack copied to clipboard

scripts: Add lightvector's cyclic position evaluation script

Open tomtseng opened this issue 1 year ago • 0 comments

Add lightvector's cyclic position evaluation script + games, with the following modifications to the script:

  • Linting
  • Change some hardcoded values into CLI arguments (config, model, katago executable, number of visits, output directory)
  • Allow overriding the rules with Tromp-Taylor + komi 6.5 (since this is the only rule set our h* adversaries are trained with)
  • Add flag --output-scores that makes the script output an average correctness score rather than plotting correctness scores for each cyclic position

The first commit in this PR copies lightvector's script with no changes, and the second commit only lints. Diffing the last commit with the second commit is the cleanest way to shows the changes that this PR made to lightvector's script.

Used for generating results here: https://www.notion.so/chaiberkeley/evaluate-katago-nets-on-cyclic-positions-f497e9715dc34bc99aa96e8053b83b1a?pvs=4

tomtseng avatar Feb 24 '24 10:02 tomtseng