Task list

[mdiephuis]

TODO

• [x] os check if exists for models and runs directory
• [x] Build features / head output
• [x] Check torch build in resnet model
• [x] make linear head
• [x] normalize features
• [x] dummy run
• [x] add tqm
• [x] check the loss over 500 epochs
• [x] save model weights
• [x] allow model save and continue
• [x] feature output -> save
• [x] test architecture boiler plate code
• [x] build simple linear classifier on top
• [x] grad accumulation across gpu
• [x] investigate large batch sizes
• [ ] Better accuracy metric for model checkpointing
• [ ] Make distributed multigpu version
• [ ] new LARS version
• [ ] add requirements