OpenChatKit
OpenChatKit copied to clipboard
togethercomputer
**Describe the bug** (base) samchen@Sams-MacBook-Pro miniconda3 % conda env create -f environment.yml EnvironmentFileNotFound: '/Users/samchen/miniconda3/environment.yml' file not found **To Reproduce** Steps to reproduce the behavior: 1. Install miniconda3 2. run "...
**Describe the bug** When trying to set up the conda environment, it is failing to install the nccl package. ``` (base) PS D:\OpenChatKit> conda env create -f environment.yml Collecting package...
While trying out `python inference/bot.py --retrieval --model togethercomputer/GPT-NeoXT-Chat-Base-20B` I got this error on A100 GPU: ``` File "inference/bot.py", line 185, in main() File "inference/bot.py", line 173, in main OpenChatKitShell( File...
**Describe the bug** One user reported `conda env create -f environment.yml` taking over 60 minutes. We need a better solution. **To Reproduce** Steps to reproduce the behavior: 1. Run `conda...
**Describe the bug** `pretrained/GPT-NeoX-20B/prepare.py` can take a long time to prepare the base model. It should print progress as it's converting. **To Reproduce** Steps to reproduce the behavior: 1. run...
1. How to reproduce HF App's behavior (hyper-parameters, exact prompt) 2. How to fine-tune models given a new corpus + things to be careful about and best practice
Feedback from a user: When running the training script, it's not clear that it's making progress. The only way to know that it's doing something is by looking at nvidia-smi.
The bot commands for inference aren't very well documented. Add more documentation about what they do.
TODO: Add in the training script for the moderation model
