Meaninles

Results 3 comments of Meaninles

请问解决了吗

`(base) -bash-4.2# bash ./run.sh -c local -i 0,1 -b default From https://github.com/netease-youdao/QAnything * branch master -> FETCH_HEAD 当前master分支已是最新,无需更新。 model_size=7B GPUID1=0, GPUID2=1, device_id=0,1 GPU1 Model: Tesla T4 Compute Capability: null OCR_USE_GPU=False...

qanything的多gpu,是不是只是把llm和其他embedding、rerank模型分开跑呀?并不是vllm那种多gpu的意思吗?