Y.Y.

怎么实现在多GPU 上微调训练？

1

使用微调命令如下： ``` CUDA_VISIBLE_DEVICES=0 python src/train_sft.py --model_name_or_path /data/chatglm2-6b \ --do_train \ --dataset comparison_gpt4_zh \ --finetuning_type lora \ --output_dir /tmp/output/comparison_gpt4_zh \ --overwrite_cache \ --per_device_train_batch_size 2 \ --gradient_accumulation_steps 4 \ --lr_scheduler_type cosine \...

[Bug] [Module Name] Bug title

2

### Search before asking - [X] I had searched in the [issues](https://github.com/eosphoros-ai/DB-GPT/issues?q=is%3Aissue) and found no similar issues. ### Operating system information Linux ### Python version information 3.10 ### DB-GPT version...

vicuna-13b-v1.5 无法在两个GPU加载模型

2

### Search before asking - [X] I had searched in the [issues](https://github.com/eosphoros-ai/DB-GPT/issues?q=is%3Aissue) and found no similar issues. ### Operating system information Linux ### Python version information 3.10 ### DB-GPT version...

[Usage]: ValueError: The checkpoint you are trying to load has model type `qwen2_5_vl` but Transformers does not recognize this architecture

16

### Your current environment ``` raise e File "/usr/local/lib/python3.12/dist-packages/vllm/transformers_utils/config.py", line 225, in get_config config = AutoConfig.from_pretrained( ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/dist-packages/transformers/models/auto/configuration_auto.py", line 1073, in from_pretrained raise ValueError( ValueError: The checkpoint you are...