swift icon indicating copy to clipboard operation
swift copied to clipboard

Published 20 hours ago • verified publisher icon modelscope

swift export 指定 --tensor_parallel_size --gpu_memory_utilization 感觉不管用

Open LIUKAI0815 opened this issue 1 month ago • 6 comments

swift export 对百川2进行awq量化 指定 --tensor_parallel_size --gpu_memory_utilization 感觉根本不管用，指定4张卡，只会用两张卡，然后就是爆显存

LIUKAI0815 avatar May 20 '24 15:05 LIUKAI0815