keras-nlp
keras-nlp copied to clipboard
Add Swin-UNETR to Keras-Hub
Is your feature request related to a problem? Please describe.
Swin-UNETR was originally designed for 3D medical image segmentation, using Swin Transformers for effective feature extraction. However, there is currently no implementation of this model available on Keras Hub.
MONAI provides Swin-UNETR for both 2D and 3D segmentation tasks, offering a well-optimized framework for medical image analysis. Having Swin-UNETR to Keras Hub would make it easier for users to apply it with torch backend in MONAI workflows.
Describe the solution you'd like
Paper of Swin-UNETR: https://arxiv.org/abs/2201.01266 Cited by (until now): 1341
Additional context
- The backbone of Swin-UNETR is Video Swin Transformer model with few modifications.
- Having Keras 3 implementation, it would be possible to run it with MONAI with torch backend.
- In order to run it with Keras 3 workflows with all backend (instead of MONAI), several utilities methos will be required, i.e.
- sliding_window_inference
- Augmentation methods, i.e. ScaleIntensityRanged, CropForegroundd, RandCropByPosNegLabeld, Spacingd, etc. These are from MONAI.
- Segmentation metrics: DICE for 3D cases.
- I am open to contributing to this effort if the Keras team considers it an important and high-priority feature.