go_attack
go_attack copied to clipboard
scripts: Add lightvector's cyclic position evaluation script
Add lightvector's cyclic position evaluation script + games, with the following modifications to the script:
- Linting
- Change some hardcoded values into CLI arguments (config, model, katago executable, number of visits, output directory)
- Allow overriding the rules with Tromp-Taylor + komi 6.5 (since this is the only rule set our h* adversaries are trained with)
- Add flag
--output-scores
that makes the script output an average correctness score rather than plotting correctness scores for each cyclic position
The first commit in this PR copies lightvector's script with no changes, and the second commit only lints. Diffing the last commit with the second commit is the cleanest way to shows the changes that this PR made to lightvector's script.
Used for generating results here: https://www.notion.so/chaiberkeley/evaluate-katago-nets-on-cyclic-positions-f497e9715dc34bc99aa96e8053b83b1a?pvs=4