torchchat icon indicating copy to clipboard operation
torchchat copied to clipboard

evaluation.md instructions not working

Open mikekgfb opened this issue 9 months ago • 0 comments

the evaluation.md file contains instructions that are not reproducible with torchchat/scripts/run-docs evaluation

At present that's fixed by exit 0 before the test commences. The reported error is missing a checkpoint, even though we pass a wellknown model into the torchchat command. I haven't had a chance to look yet, but suspect eval might not be properly integrated with the torchchat top level? (either on torchchat or eval side... even thought we have tests elsewhere)

mikekgfb avatar May 17 '24 23:05 mikekgfb