realistic-ssl-evaluation
realistic-ssl-evaluation copied to clipboard
Special value 'latest' to evaluate latest available checkpoint
Thanks for this! It creates a little bit of a semantic clash though - when the checkpoint is latest
, it uses results_dir
; when it's a path, it assumes a full path. I think it would be fine to make it so when eval_single_checkpoint
is a filename, it still uses results_dir
to create the full path. WDYT?