Training on multiple categories

[Jiaxin-Lu]

Hi @ZhaoyangLyu,

Thank you for your incredible work. I have a question regarding the generalization ability of the model to multiple categories.

I noticed that the published checkpoints and training scripts are all category specific. I'm curious to know if it would be possible to have a model that can handle multiple categories. If that is indeed possible, would the checkpoint or the script be made publicly available? On the other hand, if it's not feasible, I would be interested to learn about any experiences, both successful or unsuccessful, that you or your team have had in attempting to train a model for multiple categories.

Thank you in advance for your response. I'm eagerly looking forward to hearing from you!

[yama514]

Great work! I have a similar query on cross-category generalization. Happy to hear. Thanks.

[ZhaoyangLyu]

Thanks for your interest in our work! It is possible to train a model that can handle multiple categories, we have not tried this because we need to compare our method with previous category-specific models. Therefore, we do not have a cross-category model to share with you at this moment, but we will try this in the future. And you are welcome to train a cross-category model by yourself using the released code.