githubpradeep issues

Repositories
Issues
Comments

Results 4 issues of


                                            githubpradeep

Need code for working example

need mixtral offload for NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO

Internet search is very slow using orca mini on 4bit in google colab T4 on gradio

load-in_4_bit creates junk response

![Screenshot 2023-10-17 at 10 00 16 AM](https://github.com/OpenLemur/Lemur/assets/3142051/d44064db-13e9-4697-92d1-483006e22525) ![Screenshot 2023-10-17 at 9 59 56 AM](https://github.com/OpenLemur/Lemur/assets/3142051/c07968c1-d69c-4b3c-89fb-904e0b57b4af) !pip install git+https://github.com/huggingface/transformers.git