LAMP icon indicating copy to clipboard operation
LAMP copied to clipboard

inference_script

Open HyeBin-Hub opened this issue 1 year ago • 1 comments

Hi, thanks a lot for your interesting work! I know that in your paper you explain that you use the T2I model to generate the first frame during inference, but there doesn't seem to be any code in the "inference_script" that generates the first frame. I'm wondering if I'm mistaken.

HyeBin-Hub avatar Nov 23 '23 09:11 HyeBin-Hub

You can use https://huggingface.co/docs/diffusers/using-diffusers/sdxl to generate the first frame. Our project uses a lower version of diffusers, and SD-XL is integrated in a higher version of diffusers. Aligning the two versions is a bit tricky. Maybe I'll do that later, and add the code of first-frame generation in this repo

RQ-Wu avatar Nov 23 '23 09:11 RQ-Wu