PaddleNLP icon indicating copy to clipboard operation
PaddleNLP copied to clipboard

Published 20 hours ago β€’ verified publisher icon PaddlePaddle

support multicard export for qwen

Open Wanglongzhi2001 opened this issue 11 months ago β€’ 3 comments

PR types

New features

PR changes

Others

Description

support multicard export for qwen

ιͺŒθ―ζ–Ήζ³•οΌš θΏθ‘ŒδΈ‹ι’ηš„ε‘½δ»€θΏ›θ‘ŒδΈ€ε‘ε―Όε‡Ί:

python -m paddle.distributed.launch --gpus 1,2 export_model.py --model_name_or_path qwen-vl/qwen-vl-7b-static --output_path ./QWen_check_points --dtype float16 --inference_model

Wanglongzhi2001 avatar Mar 20 '24 08:03 Wanglongzhi2001