nnue-pytorch icon indicating copy to clipboard operation
nnue-pytorch copied to clipboard

Testing trained model

Open benliu961 opened this issue 1 year ago • 7 comments

Hello,

I have a trained model. How would I get predictions and testing accuracy using a test dataset?

Thank you!

benliu961 avatar Apr 18 '23 17:04 benliu961

That would be the validation loss, but generally we test newly trained nets by playing games with run_games.py. easy_train.py shows how this can be done. Nets that test well locally can be tested on fishtest as well.

vondele avatar Apr 18 '23 20:04 vondele

If I fine tuned the model so that it doesn't predict board evaluations anymore, how would I test it?

benliu961 avatar Apr 18 '23 21:04 benliu961

What does it predict?

Blimpyway avatar Apr 18 '23 21:04 Blimpyway

It predicts a value that I have defined as Value of Computation. Its just some value between 0 and 1

benliu961 avatar Apr 18 '23 21:04 benliu961

Unless this value represents some truth there is no way to test other than play games.

Sopel97 avatar Apr 18 '23 21:04 Sopel97

Is there no way to test it via tensorflow?

benliu961 avatar Apr 18 '23 21:04 benliu961

best you can do is look at loss

Sopel97 avatar Apr 18 '23 21:04 Sopel97