githubpradeep

@lyogavin i tried this out today. I have a suggestion here. What i noticed is the GPU is not utilized fully in this case. For example ![Screenshot 2023-11-30 at 9...

i waited for more than 15 minutes and didnt get the response

i chose 13B and loaded it in 4bit