i-Code icon indicating copy to clipboard operation
i-Code copied to clipboard

Can the provided models perform multi-label classification?

Open plamb-viso opened this issue 2 years ago • 1 comments

The provided code examples provide a good example of single label classification (e.g. rvlcdip). But can this be easily extended to multi-label classification? I'm a bit new to models where the predicted label is the actual textual representation of the label versus an integer. In the latter case multi-label can be provided through one-hot encoding an array of possible labels; does UDOP have a similar extension from single label to multi-label? How would one do it?

plamb-viso avatar Mar 07 '23 16:03 plamb-viso

We are a generative open vocabulary model so the answer should be yes. We have a text decoder to generate text so there is no reason UDOP can't generate text.

zinengtang avatar Mar 09 '23 19:03 zinengtang