MiniCPM-V icon indicating copy to clipboard operation
MiniCPM-V copied to clipboard

Finetuning feature added for setting `vision_lr` and `resampler_lr`

Open 2U1 opened this issue 1 year ago • 1 comments

feat: added fuction for creating each other optimizers to set vision_lr and resampler_lr

fix: resolve issue where saving was not functioning correctly

chore: update args with hyperparameters for improved fine-tuning performance

2U1 avatar Aug 28 '24 01:08 2U1

Can you make this PR merged? This would be helpful for pepole who wants to finetune the model, following some other papers like LLaVA-Next. By my experience, setting the learning rates converges bit faster and showed better performance on my task.

2U1 avatar Sep 18 '24 08:09 2U1