MONAI icon indicating copy to clipboard operation
MONAI copied to clipboard

Implement the ability to use layernorm with resnet models

Open MiguelMonteiro opened this issue 1 year ago • 3 comments

Is your feature request related to a problem? Please describe. Batch norm can be problematic with small batch sizes and certain applications due to computing running batch statistics. Layernorm does not have this problem but it is not available to use in with monai's resnet models:

from monai.networks.nets.resnet import ...

Describe the solution you'd like Implement the ability to use layer norm with resnet models

Describe alternatives you've considered I have tried using other models which support layer norm such as densenet but it seems to be broken also. See https://github.com/Project-MONAI/MONAI/issues/7293

MiguelMonteiro avatar Dec 06 '23 16:12 MiguelMonteiro

Hi @KumoLiu

Could I work on this?

aymuos15 avatar Dec 08 '23 16:12 aymuos15

@aymuos15, sure, please refer to the CONTRIBUTION GUIDE.

KumoLiu avatar Dec 08 '23 16:12 KumoLiu

Thank you!

aymuos15 avatar Dec 08 '23 16:12 aymuos15