nanoGPT
nanoGPT copied to clipboard
checkpoints don't seem to be working
I'm testing out train.py on google colab but no checkpoints are created, even after iter 1000 .
I'm using this command:
!cd /content/nanoGPT/ && python train.py --dataset=shakespeare --compile=False --n_layer=4 --n_head=4 --n_embd=64 --eval_iters=20 --block_size=64 --batch_size=8 --init_from=gpt2 --always_save_checkpoint=True --dtype=float32
The eval_interval is 2000 by default, maybe then?
just tested it, seems to be 2000 thanks :) for ref its line 36: eval_interval = 2000
If anyone is curious, I've done a small writeup of using Google Colab to finetune nanoGPT on shakespeare. GitHub Repo Link