InternVL icon indicating copy to clipboard operation
InternVL copied to clipboard

how many gpus and how long time does it cost for V1-5 model finetuning?

Open cyj95 opened this issue 1 year ago • 0 comments

internvl_chat/shell/internlm2_20b_dynamic/internvl_chat_v1_5_internlm2_20b_dynamic_res_finetune.sh

how many gpus are need for finetuning?

I noticed that for 1-2 version: Note: fine-tune the full LLM needs 16 A100 80G GPUs, and fine-tune the LoRA needs 2 A100 80G GPUs.

how about V1-5 model finetuning ? and how long time will it spend?

cyj95 avatar May 24 '24 07:05 cyj95