thanhnew2001

any update on this please?

I think this might be the reason. " This may helpful, put it in SavePeftModelCallback if state.best_model_checkpoint is None: print(f"Setting best_model_checkpoint to {checkpoint_folder}") state.best_model_checkpoint = checkpoint_folder elif state.best_model_checkpoint.endswith(checkpoint_folder): print(f"Updating best_model_checkpoint...

I have the same problem. Tried to finetune starcoder with qlora but they all failed. Probably, qlora does not support starcoder. I could run the finetune starcoder with qlora but...

Any progress on this please. Highly appreciated.

Yes, that's true. I had the same problem. It i weird that however you can run the Alpaca 52k without problem.

Indeed, no luck with 24g VRAM. Some big dataset even failed in 80g machine. I was successful with Alpaca 52k in 80g machine. Two options: reduce the dataset size and...

No, you need at least 48G RAM but it also depends on the size of your training dataset.

It still depends on the size of your dataset. Dolly 15k might be ok. Alpaca 50k might not be enough. I was successful with 80GB RAM Best regards, Thanh On...

No, it didn’t work with that small memory. I tried many times but yes if some one else could provide their own experience, it would be great Thanh On Wed,...

20s is weight too slow for one image.