hfppl
hfppl copied to clipboard
Bug: Tensor device error when using multiple gpu
When running examples/hard_constraints.py using two gpus, has following error:
hfppl/hfppl/llms.py", line 244, in past_padded
return torch.cat(
^^^^^^^^^^
RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:1 and cuda:0! (when checking argument for argument tensors in method wrapper_CUDA_cat)