Features : Can it use 4 bit QLORA ?

[x4080]

from https://huggingface.co/blog/4bit-transformers-bitsandbytes ?

[JetRunner]

Yes, just modify the utils.py following the example from HF blog:

model = AutoModelForCausalLM.from_pretrained("facebook/opt-350m", load_in_4bit=True, device_map="auto")

We'll update the code after testing.

[x4080]

cool, thanks @JetRunner