lora-instruct

lora-instruct copied to clipboard

Thanks for the wonderful code. While training Falcon-7B on Alpaca dataset, the training loss is not reducing. It used to work fine. Were there any recent changes?

pcvishak

Thanks for the wonderful training code. Please release the inference code as well.

pcvishak

Hey @leehanchung Does lora-instruct support fine tuning mpt-30b family of models out of the box?

creatorrr

Hello. Is there support for quantized lora finetuning of those llms? Thanks

louisoutin

Error message when training MPT-7B

2

Hi I got a message when I try to use Lora to train MPT-B, do you have any ideas to solve it? ValueError: Unable to create tensor, you should probably...

jianchaoji

cwzhao

Can this codebase be applicable for finetuning larger models, e.g., falcon-40b?

ZeroYuHuang

Training on Colab possible?

2

Hi, I'd like to know if training on Colab is possible

CypherpunkSamurai

Error message during training

1

Hi, I truncated "alpaca_data.json" to reduce training time and saved it in another file for training. Unfortunately, using this file gives me the error "pyarrow.lib.ArrowInvalid: JSON parse error: Column() changed...

ChinJY

Feat/falcon

1

leehanchung