OpenChatKit
OpenChatKit copied to clipboard
togethercomputer
Hi What is minimum specification to replicate it on local machine.
**Is your feature request related to a problem? Please describe.** A docker image might be easier for people to use. **Describe the solution you'd like** We could add a /docker...
I noticed that OIG dataset adds human and bot tag in each sample. In your code, you directly pack samples to max seq length and calculate cross entropy on whole...
What kind of data to provide for finetuning ? What are the best practices for finetuning ?
python data/OIG/prepare.py File "data/OIG/prepare.py", line 27 gzip.open(f, 'rb') as infile, ^ SyntaxError: invalid syntax Tell me why, thank you!
ChatGPT supports multi-language question answering and reasoning, although in most cases, English answers are generated first and then translated into other languages. So I want to ask whether OpenChatKit supports...
After viewing your code , I found that you haven't support RLHF training yet. Your code is mainly about distributed training using pipeline & data parallel. Do you have the...
This was causing inference/bot.pl to fail on a new git clone. Per Charles it can be safely removed.
**Describe the bug** Followed the instructions but could not get ``` conda env create -f environment.yml ``` to work because of ``` ResolvePackageNotFound: - cudatoolkit=11.6.0 - faiss-gpu=1.7.2 - nccl=2.12.12.1 -...
