OpenAssistant_API_Pythia_12B
OpenAssistant_API_Pythia_12B copied to clipboard
Sentdex
Creating and Using an Open Assistant API locally (Pythia 12B GPT model)
I run the file oasstapiv1.py. All downloads have been made. And then it just says "Killed". No idea if there is a log file somewhere. I am using Ubuntu 20.04...
Using an nvidia P40 when starting the API script the following error message occurs. (GPU is not used for video output, all 24 GB VRAM is available) ``` Traceback (most...
Super cool demo ... ! Just wanted to mention that our SFT-8 pythia-12b is now also available: [OpenAssistant/pythia-12b-sft-v8-7k-steps](https://huggingface.co/OpenAssistant/pythia-12b-sft-v8-7k-steps). Outputs of both SFT-4 & SFT-8 side-by-side can be viewed [here](https://open-assistant.github.io/oasst-model-eval/?f=https%3A%2F%2Fraw.githubusercontent.com%2FOpen-Assistant%2Foasst-model-eval%2Fmain%2Fsampling_reports%2Foasst-sft%2F2023-04-03_andreaskoepf_oasst-sft-4-pythia-12b-epoch-3_5_sampling_noprefix_lottery.json%0Ahttps%3A%2F%2Fraw.githubusercontent.com%2FOpen-Assistant%2Foasst-model-eval%2Fmain%2Fsampling_reports%2Foasst-sft%2F2023-05-07_OpenAssistant_pythia-12b-sft-v8-7k-steps_sampling_noprefix2.json). The...
