human-pose-estimation.pytorch icon indicating copy to clipboard operation
human-pose-estimation.pytorch copied to clipboard

Published 20 hours ago • verified publisher icon microsoft

cudnn and pytorch 1.0

Open bloodymeli opened this issue 6 years ago • 2 comments

Hi,

Is there a way to disable cudnn for batch norm on pytorch 1.0?

bloodymeli avatar Dec 14 '18 23:12 bloodymeli

You can try pytorch 1.0 with cudnn enabled, it seems that pytorch 1.0 has fixed the bug.

leoxiaobin avatar Dec 17 '18 03:12 leoxiaobin

@leoxiaobin could you please explain the difference in the behaviors from CUDNN's BN implementation and pytorch's?

We observe similar behavior when training with MXNet, so any insight would be helpful. Thank you!

hetong007 avatar Jan 10 '19 23:01 hetong007