HALC The Fig 1. experiment detail

I have read your paper, it is a great work. However, I have a few questions about the details of Fig 1. experiment, which you have conducted to verify the significance of optimal visual context. What I don't understand is that after the brutal force search for the optimal visual context, how is the visual context used to generate the correct answer? Is it used as an individual image as the visual input or used in your proposed framework? Thank you for your explanation!

May 10 '24 08:05 Stevetich

Hi, thanks for your interest in HALC! For the images searched with brutal force, we simply input it into the VLM as an individual image. You can also manually fix the retrieved optimal visual context into our framework so that you can automate the inference process. Please let me know if there's any further questions, thanks:)

May 14 '24 15:05 BillChan226

Thanks for your reply! I have no more questions.

May 23 '24 08:05 Stevetich

Hi, thanks for your interest in HALC! For the images searched with brutal force, we simply input it into the VLM as an individual image. You can also manually fix the retrieved optimal visual context into our framework so that you can automate the inference process. Please let me know if there's any further questions, thanks:)

Thank you for your work. May I ask if you can share the manually constructed questions in the Oracle experiment?

Sep 04 '24 03:09 darwann

Hi, thanks for your interest in HALC! For the images searched with brutal force, we simply input it into the VLM as an individual image. You can also manually fix the retrieved optimal visual context into our framework so that you can automate the inference process. Please let me know if there's any further questions, thanks:)

Thank you for your work. May I ask if you can share the manually constructed questions in the Oracle experiment?

Hi, we used the questions as provided in MME benchmark.

Sep 06 '24 08:09 BillChan226