ada-hessian icon indicating copy to clipboard operation
ada-hessian copied to clipboard

bug about generater

Open carry-xz opened this issue 4 years ago • 3 comments

hi, I find some err when trying to use the adahessian optimizer, like ''AttributeError: 'torch._C.Generator' object has no attribute 'device'", pytorch version: 1.1.0

carry-xz avatar Jan 26 '21 05:01 carry-xz

Hi, please update your PyTorch to the newest version :)

davda54 avatar Jan 26 '21 08:01 davda54

thanks for reply, i update pytorch to 1.6, and find a new err "line 83, RuntimeError: element 0 of tensors does not require grad and does not have a grad_fn" what is your version of pytorch?

carry-xz avatar Jan 29 '21 08:01 carry-xz

@carry-xz I have the same issue than you with tensors that have been detached or for which the gradient has not been computed ... although the index element of the tensors vary around 20 for me

ayman-makki avatar Feb 11 '21 07:02 ayman-makki