HOI-CL icon indicating copy to clipboard operation
HOI-CL copied to clipboard

unseen zero-shot seeting

Open xuliwalker opened this issue 3 years ago • 1 comments

Hi, thanks for your work! I am interested in the unseen composition and unseen object zero-shot setting in FCL paper, and I am wondering where can I find the code for generating the training and testing sets for these two zero-shot settings. Thank you!

xuliwalker avatar Jan 17 '22 13:01 xuliwalker

Those HOI ids are for rare first zero-shot setting. https://github.com/zhihou7/FCL/blob/12bc2d4bef4fd2d7d295b33d15f023ae266bc519/lib/ult/ult.py#L400, while this line is for non-rare first zero-shot setting (https://github.com/zhihou7/FCL/blob/12bc2d4bef4fd2d7d295b33d15f023ae266bc519/lib/ult/ult.py#L427).

This line (https://github.com/zhihou7/FCL/blob/12bc2d4bef4fd2d7d295b33d15f023ae266bc519/lib/ult/ult.py#L534) shows how I remove the unseen classes during training.

For json format input (e.g. qpic), I guess this script might help you. https://gist.github.com/zhihou7/d3c7563a1b8244bf3914ed0853c7ea04

Please notice the category id between different repositories might be different. You should convert it by yourself.

Regards,

zhihou7 avatar Jan 18 '22 03:01 zhihou7