VITA icon indicating copy to clipboard operation
VITA copied to clipboard

Published 20 hours ago • verified publisher icon VITA-MLLM

各位大佬，这个要多少显存才能跑呀，interactive demo的，可以指定多张卡吗

Open Ko24Bewjw opened this issue 10 months ago • 3 comments

Ko24Bewjw avatar Jan 11 '25 06:01 Ko24Bewjw

2 48G GPUs or 1 80G GPU

BradyFU avatar Jan 12 '25 02:01 BradyFU

最新版本已支持指定双卡

lxysl avatar Jan 13 '25 03:01 lxysl

每个模型可以指定双卡吗？试了下tensor_parallel_size = 2，报“RuntimeError: CUDA error: an illegal memory access was encountered”的错误 @lxysl https://github.com/VITA-MLLM/VITA/issues/41#issue-2526775880

Anonymous4CV avatar Jan 14 '25 09:01 Anonymous4CV