ada-hessian
ada-hessian copied to clipboard
bug about generater
hi, I find some err when trying to use the adahessian optimizer, like ''AttributeError: 'torch._C.Generator' object has no attribute 'device'", pytorch version: 1.1.0
Hi, please update your PyTorch to the newest version :)
thanks for reply, i update pytorch to 1.6, and find a new err "line 83, RuntimeError: element 0 of tensors does not require grad and does not have a grad_fn" what is your version of pytorch?
@carry-xz I have the same issue than you with tensors that have been detached or for which the gradient has not been computed ... although the index element of the tensors vary around 20 for me