ptrblck
ptrblck
@vellamike The PTX JIT issue should be solved once https://github.com/pytorch/pytorch/pull/48455 is landed. Let me know, if you suspect another unrelated bug for the OOM issue and ping me to take...
For 11.7: Created two PRs to add the docker and magma builds. CC @crcrpar Could you check the launch bounds for `torch.mode` in 11.7, please? CC @IvanYashchuk Adding you for...
Hi @JizeCao, could you check your loss and see, if it's a valid value or Inf/Nan? If that's the case, could you run the code again using [Anomaly Detection](https://pytorch.org/docs/stable/autograd.html#anomaly-detection) as...
Thanks for the information! Could you check, which `queries` tensor creates this issue? Based on the stack trace I would guess you encounter an overflow in `input.matmul(weight.t())`, so the `weight`...
@zhixuanli Which GPUs are you using and do you have a reproducible code snippet? Was `apex` installed successfully?
Hi @qlwang25, the first installation seems to have failed, but I cannot find the actual error message. Did you see any errors in the build output? Regarding importing apex and...
@zsun1029 Could you check your output and see, if it contains invalid values (NaN or Inf)?
@crcrpar would it be possible to guard this option for nvcc>=11.2?
CC @seryilmaz
> but I found the pytorch latest version from this website is 10.2 The latest PyTorch binaries can be installed with CUDA11.0 as shown in the [install instructions](https://pytorch.org/get-started/locally/). Note that...