DiffDRR icon indicating copy to clipboard operation
DiffDRR copied to clipboard

Get the initialization neural network working

Open eigenvivek opened this issue 3 years ago • 2 comments

Nalini's advice:

  1. Check the training loss
  2. Make sure the network can learn a single example
  3. Use batchnorm
  4. Use residual connections
  5. Try a deeper network
  6. Try to predict just a few parameters (eg, just project through an axis-aligned slice)

eigenvivek avatar Aug 22 '22 20:08 eigenvivek

NN works perfectly well with MSELoss. The issue is defining a loss function with the DRR module. This is because the DRR module makes the geometrics base parameters... that is, I can't pass parameters from another layer without losing the gradient

Fix will require a change to the API to input torch.tensors (will implicitly fix #30, but will break all other examples).

eigenvivek avatar Aug 23 '22 13:08 eigenvivek

Or one can simply make the projection its own function for use as an intermediate layer :)

eigenvivek avatar Aug 23 '22 14:08 eigenvivek

Batched DRR rendering was completely broken (#107), but fixed now!

eigenvivek avatar Feb 02 '23 20:02 eigenvivek