nerfstudio icon indicating copy to clipboard operation
nerfstudio copied to clipboard
verified publisher icon nerfstudio-project

Instant-NGP epsilon produces worse results early in training

Open tancik opened this issue 3 years ago • 1 comments

Related to PR #134 and Issue #117 cc: @brentyi

eps: 1e-4 iter 200: image

iter 500 image

eps: Default iter 200: image

iter 500: image

tancik avatar Jul 15 '22 00:07 tancik

Hmm yeah ideally we can lower the eps value, which I'd guess is doable with one or both of:

  • Weight decay
    • It's possible this would let us swap the softplus density activation back in too, since the trunc exp also seemed to hurt the training curve early on (see curve in #104)
  • Mixed-precision (via torch.amp?) / track gradient stats in float32

brentyi avatar Jul 15 '22 00:07 brentyi

Outdated

tancik avatar Feb 22 '23 18:02 tancik