metadata
metadata copied to clipboard
Eval loop
- Add full perplexity evaluation into eval loop.
- Minor Training code changes I have been using.
- Make sure tokenizer is saved.