torchgeo icon indicating copy to clipboard operation
torchgeo copied to clipboard

ObjectDetectionTask support for MSI

Open adamjstewart opened this issue 2 years ago • 4 comments

Summary

The ObjectDetectionTask has an in_channels parameter but it isn't actually used for anything. At the moment, it seems that the trainer only supports RGB imagery. We should fix this.

Rationale

We specialize in MSI, how can we not support MSI.

Implementation

We're currently using torchvision backbones, which makes things more challenging. How hard would it be to switch to timm backbones?

Alternatives

Alternatively, we'll have to override the first channel of the torchvision backbone.

Additional information

No response

adamjstewart avatar Mar 04 '23 04:03 adamjstewart

The adaption for multi-channel looks straightforward - not sure about handling the pretrained weights

https://github.com/allenai/vessel-detection-sentinels/blob/main/src/models/frcnn.py

robmarkcole avatar May 31 '24 07:05 robmarkcole