Adding Panoptic Segmenation

[trs96]

Hey, I'm trying to connect your tool with my system to import images, label them, do a panoptic segmentation an then export it back again to my system.

Could you please help me out with the panoptic segmentation? 1. I don't know exactly, where in the code I can add the button. 2. How would you recommend to do the panoptic segmentation?

[bijayaniSMishra]

Hey, I have the same doubt.. I have annotated using the polygon tool but not sure how to export it in panoptic format? If you have solved it.. please help.

[simonwibberley]

I found a script to convert to panoptic format https://github.com/cocodataset/panopticapi However, when trying to train detectron2 with the result I get an error about a missing id in the JSON. I don't understand enough about the panoptic approach to get much further. I'm guessing semantic and instance annotations need to be distinguished in some way?

[bijayaniSMishra]

I used coco annotator json directly and before training the models i just added MetadataCatalog.get("my_dataset_train_2").stuff_classes = ["Class1", "Class2","Class3"] after that i was able to train and inference the panoptic model.