CQL icon indicating copy to clipboard operation
CQL copied to clipboard

GEN-VLKT+CQL

Open paihuai00 opened this issue 2 years ago • 4 comments

When applying the CQL method to GEN-VLKT, how should we handle the CLIP weight for verb classification?

Can you provide the relevant code?

paihuai00 avatar Sep 13 '23 14:09 paihuai00

When applying CQL to GEN-VLKT, we use CLIP weight to initialize the category queries. I will upload the code for this part after finishing a recent deadline :smiley:

Charles-Xie avatar Sep 15 '23 08:09 Charles-Xie

When applying CQL to GEN-VLKT, we use CLIP weight to initialize the category queries. I will upload the code for this part after finishing a recent deadline 😃

How's it going?

paihuai00 avatar Oct 15 '23 08:10 paihuai00

Thank you for your work. It has been three months. Can you release the code for GENVLKT+CQL now? I'm having trouble with its performance.

xiguahong avatar Oct 21 '23 16:10 xiguahong

@Charles-Xie Hello, I would like to inquire whether the CLIP weight used to initialize the category queries is derived from the HOI triplet text or just from interaction text, and how? What is the coefficient for the image loss in GEN? Could you update some code examples?

kkayla99 avatar Nov 02 '23 14:11 kkayla99