Using mask rcnn data

[nirat1606]

Hi Fabien,

I want to use the mask-rcnn predictions for EPIC-Kitchen dataset. Can you elaborate how to interpret the pickle files provided as Complementary data-masks. For beginning, I would like to know a way to overlay mask and bounding boxes on the corresponding frames. Any tutorial or readme for doing so would be highly appreciated

Thanks, Nirat

[fabienbaradel]

Hi Nirat,

Thanks for the interest in our work. You can find the line by line implementation about how to retrieve the bboxes/segmentations for each detected objects per frames here. First I am retrieving the object id, then reformatting the bounding box and finally rescaling the mask. If you feel that the predictions are not good enough you can use this pre-trained Mask-RCNN on your own data. I hope that these explanations could help for your work. Best,

Fabien