segment-anything-with-clip icon indicating copy to clipboard operation
segment-anything-with-clip copied to clipboard

Published 20 hours ago • verified publisher icon Curt-Park

counter-examples

Open PerrinAntonin opened this issue 2 years ago • 3 comments

Hi! Do you think it's possible to modify the code to add images counter-examples in the support set?

PerrinAntonin avatar Jun 02 '23 08:06 PerrinAntonin

Could you explain more about counter example? By the way, PullRequest is warmly welcomed.

Curt-Park avatar Jun 04 '23 13:06 Curt-Park

Sorry, I should have provided more context, but I was wondering if, in order to increase performance, it would be useful to provide images of other categories. For example, we're looking for dogs of a specific breed and the CLIP model isn't necessarily powerful enough to put a name to that breed. We could provide images of other breeds of dog in order to differentiate them.

PerrinAntonin avatar Jun 05 '23 11:06 PerrinAntonin

I think it's a possible approach. We can use the clip image embedding instead of text embeddings.

Curt-Park avatar Jun 13 '23 11:06 Curt-Park