KIVI icon indicating copy to clipboard operation
KIVI copied to clipboard

Published 20 hours ago • verified publisher icon jy-yuan

Multi GPUs

Open yisunlp opened this issue 5 months ago • 5 comments

I ran mem_spd_test.py and got the following error: RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cuda:1! I did not make any changes except the path of the model. I manually changed the device and got the same error as https://github.com/jy-yuan/KIVI/issues/24 Any suggestions？

image

yisunlp avatar Aug 30 '24 01:08 yisunlp