OpenChatKit icon indicating copy to clipboard operation
OpenChatKit copied to clipboard

Add print statements to `pretrained/GPT-NeoX-20B/prepare.py` to show progress

Open csris opened this issue 2 years ago • 2 comments

Describe the bug pretrained/GPT-NeoX-20B/prepare.py can take a long time to prepare the base model. It should print progress as it's converting.

To Reproduce Steps to reproduce the behavior:

  1. run python pretrained/GPT-NeoX-20B/prepare.py from the root of the repo.

Expected behavior The script should print progress.

csris avatar Mar 11 '23 23:03 csris

@LorrinWWW, this is a version of your script for sharding the base model. Could you please take a look?

csris avatar Mar 11 '23 23:03 csris

Sure!

LorrinWWW avatar Mar 12 '23 02:03 LorrinWWW