zebraone issues

Repositories
Issues
Comments

Results 3 issues of


                                            zebraone

Support Multi-part .bin files?

Hi Team, I am trying to run https://huggingface.co/NousResearch/Yarn-Llama-2-13b-128k/tree/main with llama-gpt. However unable to specify multiple .bin files (this model has 3 files) in dockerfile. Please can you suggest how we...

Any plans to implement RAG (retrieval augmented generation)?

I think this is a great project when it comes to data privacy and compliance for Organizations looking to adopt Gen AI with LLAMA 2. Adding capabilities for this private...

RuntimeError: probability tensor contains either `inf`, `nan` or element < 0

I have fine tuned a llama 7b model and when I try to run the fine tuned model I get below error: python generate/lora.py 16-true Loading model ... Time to...