sam-hq icon indicating copy to clipboard operation
sam-hq copied to clipboard

When I use ''multimask_output=True'', only one mask is generated

Open sssmallmonster opened this issue 1 year ago • 2 comments

Thank you for your efforts. I've tested SAM-hq; however, I encountered issues while running the model. Specifically, when utilizing multi-prompts along with the previous masks, I observed that only a single output mask is generated. Could you please provide some insight into this matter?

Furthermore, during my testing, I employed the sam_hq_vit_h.pth checkpoint. Although the accuracy of the obtained masks exhibited some improvement compared to the results from SAM, they still fall notably short of the quality demonstrated in the official SAM website's demo. Your guidance on these matters would be greatly appreciated. 屏幕截图 2023-08-16 154619 屏幕截图 2023-08-16 153808

sssmallmonster avatar Aug 16 '23 07:08 sssmallmonster

Hi, we select the mask with the highest score for multi-mask output. The corresponding code is in this line. It is also used in COCO evaluation or other quantitative evaluations.

ymq2017 avatar Aug 16 '23 15:08 ymq2017

MultiMask=True by definition as used in regular SAM produces the 3 highest scored images. So why can't HQ do the same?

ukaprch avatar Dec 04 '23 17:12 ukaprch