ai-toolkit icon indicating copy to clipboard operation
ai-toolkit copied to clipboard

【Question】Will we have ref (dreambooth-like) train in future ? And checkpoint funtune ?

Open NBSTpeterhill opened this issue 1 year ago • 2 comments

Dear Author: Can we use ref datasets in the future ? And checkpoint futunate ? Thanks

NBSTpeterhill avatar Aug 14 '24 07:08 NBSTpeterhill

UP

protector131090 avatar Aug 14 '24 09:08 protector131090

ref?

WarAnakin avatar Aug 15 '24 05:08 WarAnakin

All of this is technically possible but I have not tested with the latest changes. It will not work quantized, but should work bf16. You will need 80gb of vram. All you need to do is comment out the network section and it will do a full finetune. I will make sure this works properly and update the docs in the next few days

jaretburkett avatar Aug 19 '24 03:08 jaretburkett

All of this is technically possible but I have not tested with the latest changes. It will not work quantized, but should work bf16. You will need 80gb of vram. All you need to do is comment out the network section and it will do a full finetune. I will make sure this works properly and update the docs in the next few days

Thank you for your reply and neat work on ai-toolkit, happy to wait for the new update.

NBSTpeterhill avatar Aug 19 '24 15:08 NBSTpeterhill