Template color loss and Depth-based multi-view color loss

[ronly2460]

Great work. I appreciate that you share the codes.

How do these losses involve in the backwards?. In this part, just compute the output from the model. do they internally calculate loss?

https://github.com/dvlab-research/Ref-NPR/blob/main/exps/refnpr/ref_opt.py#L326-L354

[JulianJuaner]

I'm sorry for not getting back to you sooner. Those Ray-based losses backward are auto in the function grid.volume_render_fused(*), you may check it in svox2. As we pass the gt rays here, it will calculate the gradient and update the radiance field.