gsplat icon indicating copy to clipboard operation
gsplat copied to clipboard

Any plan to integrate MCMC strategy into NeRFStudio?

Open yt2639 opened this issue 6 months ago • 1 comments

Hii, is there any plan to integrate MCMC strategy into NeRFStudio's splatfacto? I've tried myself but it seems not working. I essentially add MCMCStrategy.step_post_backward link in trainer.py between self.grad_scaler.scale(loss).backward() link and self.optimizers.optimizer_scaler_step_some(self.grad_scaler, needs_step) link. Additionally, I commented out the after_train and refinement_after operations.

However, the results are pretty weird. I understand MCMC is working well with gsplat code base so I am wondering if there is any plan to integrate MCMC into nerfstudio's code base?

Thanks!

yt2639 avatar Aug 23 '24 23:08 yt2639