amrrs

Thanks for this wonderful effort. Do you have any plans to enable Python code usage (instead of CLI)?

offload_dir error on Colab

8

This error seems to be due to `accelerate` , curious if you have any solution? ``` Traceback (most recent call last): File "/content/alpaca-lora/generate.py", line 36, in model = PeftModel.from_pretrained( File...

Colab OOM

2

Hey THanks for the code. Ironically even the 3B model is crashing on Colab. This is after enabling 8-bit with fp16 precision. Did it work for anyone?

OpenAssistant Error

7

Hey Thanks for the package, When I tried using OpenAssistant. I got this error. The same code works fine with OpenAI. ``` Traceback (most recent call last): File "/usr/local/lib/python3.10/dist-packages/IPython/core/interactiveshell.py", line...

Thanks! Does it fit in Free Colab?

3

Hey Thanks very much for the effort. Looking at the released model size, Wondering if it can fit in Free Colab?

Thanks so much for this. Would love a simple starter code with `transformers`!