SEED icon indicating copy to clipboard operation
SEED copied to clipboard

Inquiry Regarding the Evaluation Details of SEED-LLaMA

Open nth2000 opened this issue 6 months ago • 0 comments

I am in the process of reproducing the evaluation of the seed-llama-8b-sft model on SeedBench-Image and COCO-test (text2image). To ensure accuracy and fidelity in my reproduction, I would be grateful if you could provide the following information:

  • For text-to-image evaluation: the Diffusion guidance, inference steps, and the LLM CFG guidance used when generating image tokens.
  • For SeedBench evaluation: the prompt template used when evaluating seed-llama 8b-instruct.

I‘m assured that this information will be used strictly for academic purposes.

nth2000 avatar Aug 05 '24 11:08 nth2000