LAVIS icon indicating copy to clipboard operation
LAVIS copied to clipboard

Where are the loss functions for ITC, ITM, and ITG in the first stage of training in blip2?

Open nuocheng opened this issue 1 year ago • 0 comments

Hello, I have carefully read articles about blip2, which has sparked a great interest in me. Also looked at the relevant core code of q transformer in blip2. I have a question and I need your help. I found the use of cross entropy loss in the experimental section of the blip2 article, but I did not find the loss section in the code. image

nuocheng avatar Feb 23 '24 04:02 nuocheng