Tune-A-Video icon indicating copy to clipboard operation
Tune-A-Video copied to clipboard

Published 20 hours ago • verified publisher icon showlab

DDIM inversion or ramdon noise?

Open tszFung-gz opened this issue 1 year ago • 2 comments

Excellent work! I have a question to ask, is this DDIM inversion necessary in the process of diffusion of video data? I tried to use DPM inversion and got seriously wrong results. I tried to use DDIM inversion and got seriously wrong style, though the better temporal consistency. What other samplers are available?

tszFung-gz avatar Jun 14 '23 03:06 tszFung-gz

Yes, DDIM inversion is necessary to preserve the motion in source video. DPM would fail as it is not deterministic. For style change, reducing finetuning steps may help.

zhangjiewu avatar Jun 20 '23 09:06 zhangjiewu

Thanks for the answer~

tszFung-gz avatar Jun 30 '23 07:06 tszFung-gz