ms-swift icon indicating copy to clipboard operation
ms-swift copied to clipboard

Merging and Exporting Qwen2-VL 7B Instruct Model to Hugging Face Hub After Fine-tuning with LoRA

Open sharonsalabiglossai opened this issue 5 months ago • 0 comments

I recently fine-tuned the Qwen2-VL 7B Instruct model using LoRA, with the USE_HF=1 environment variable set during fine-tuning. However, I am unable to find a way to merge the fine-tuned model and export it directly to the Hugging Face Hub. The current documentation seems to only provide instructions for exporting the model to ModelScope.

Is there a specific command or procedure to merge the fine-tuned LoRA model and push it to the Hugging Face Hub? Any guidance on this would be appreciated.

sharonsalabiglossai avatar Sep 25 '24 14:09 sharonsalabiglossai