hf-transllm icon indicating copy to clipboard operation
hf-transllm copied to clipboard

Expected all tensors to be on the same device

Open zeinabfarhoudi opened this issue 1 year ago • 0 comments

When I run transllm, I face this error:

RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu! (when checking argument for argument index in method wrapper_CUDA__index_select).

I set the device_map with the default value: "auto" Thanks for your help.

zeinabfarhoudi avatar Sep 24 '23 09:09 zeinabfarhoudi