algorithmic-efficiency
algorithmic-efficiency copied to clipboard
Test resetting model parameters via `workload.init_model_fn()` during training
According to the rules, it is expected that the model parameters can be reset by calling workload.init_model_fn(). However, creating a new model instance, like it is currently done in the MNIST PyTorch workload, might lead to out-of-memory errors, if the loss/optimizer and potentially other objects are not deleted properly (also described here). Hence, resetting model paramerters during training should be tested and workload.init_model_fn() should potentially be adjusted.