XinyuYe-Intel

icon indicating an email [email protected]

Results 14 comments of XinyuYe-Intel

main example for qLoRA fails: AttributeError: 'Model' object has no attribute 'named_parameters'

> Thank you, your code is working fine up to "WeightOnlyQuant done.", but then I've got a weird error in peft/tuners/tuners_utils.py", line 341, in get_base_layer: "while hasattr(base_layer, "base_layer"):" the error...

What is the best way for the inference process in LORA in PEFT approach

Hi @pradeepdev-1995 , method 1-4 basically are same methods, they all merge lora's weight to base model, thus resulting model will have same architecture with the model before finetuning except...

Optimized inference of Starcoder2 model

Hi, can you please review this PR?

Optimized inference of Starcoder2 model

> what is the transformer version you have when you run tests for this PR? Because I see starcoder2 only in transformer 4.39, and Optimum Habana's version of transformer is...