alexeiga

tried that, same error appears. both adapter and lora fail to load the checkpoint. do you have other solution?

> The above issue should be just for LoRA. Is the error exactly the same for Adapter? yes, same issue loading weights with deepspeed level 3

any update regarding this issue?

> > @weilong-web Yeah, I don't think it works out of the box... Looks like someone managed to finetune Falcon 40b - #198 > > I am able to use...

> @lynngao > > I was able to finetune on the **Falcon 40B instruct 4 bit version**. > > Were you able to finetune Falcon 40B model? I ran into...

> @alexeiga Nice. Can you please let us know the configurations? > > Also, the current main branch doesn't implement multi gpu training. How did you manage to implement it?...