pytorch_backend
pytorch_backend copied to clipboard
Run in default mode when inference mode is disabled
When INFERENCE_MODE is set to false, the model still runs in no_grad mode. Is that intentional? This prevents the serving of models that requires gradients at inference time, such as differential rendering for example. Can we instead use the default mode when INFERENCE_MODE=false (as is implemented in this pull-request) or would it be preferable to add additional parameters to enable the default mode?
Thanx!