multitask-learning icon indicating copy to clipboard operation
multitask-learning copied to clipboard

Change backbone

Open ntelo007 opened this issue 5 years ago • 2 comments

Hi,

could you please help me change the backbone neural net (to be more specific with a ResNet34 pre-trained on ImageNet) and change the final tasks with 3 classification tasks?

Thank you for your time.

ntelo007 avatar Feb 16 '20 17:02 ntelo007

This may be a complicated change due to the changes that had to be made to the base ResNet architecture in our implementation, and the complications of our training environment and tasks.

If you would like to try anyways, here are the basic things you should look at:

We modified the torchvision ResNet101 implementation to include dilated convolutions and an ASPP module. The main implementation is in encoder.py.

Since this is only the encoder portion of our network, we have to rename the torchvision resnet weights to match our architecture. See model.py.

You would also want to change our loss criterion and our decoder to match your classification tasks. The most similar to a classifier in our version is the segmentation task, since it basically does classification per-pixel. See: train.py and decoders.py.

versine avatar Feb 20 '20 18:02 versine

Could you please assist me on creating the loss function in Keras?

ntelo007 avatar Feb 28 '20 14:02 ntelo007