OpenChatKit
OpenChatKit copied to clipboard
Add print statements to `pretrained/GPT-NeoX-20B/prepare.py` to show progress
Describe the bug
pretrained/GPT-NeoX-20B/prepare.py can take a long time to prepare the base model. It should print progress as it's converting.
To Reproduce Steps to reproduce the behavior:
- run
python pretrained/GPT-NeoX-20B/prepare.pyfrom the root of the repo.
Expected behavior The script should print progress.
@LorrinWWW, this is a version of your script for sharding the base model. Could you please take a look?
Sure!