Marigold icon indicating copy to clipboard operation
Marigold copied to clipboard

Published 20 hours ago • verified publisher icon prs-eth

Video depth map deflickering

Open Fannovel16 opened this issue 1 year ago • 3 comments

Depth maps generated from video frames by Marigold is obiviously flickering. While this can be partially fixed by setting high n_repeat and fixed seed, such method is inefficent imo. Is there any way to use previous video frame/depth map to condition the diffusion process?

Fannovel16 avatar Dec 15 '23 14:12 Fannovel16

+1

darkzbaron avatar Dec 31 '23 19:12 darkzbaron

+1

leavittx avatar Jan 21 '24 14:01 leavittx

https://github.com/pablodawson/Marigold-Video May help, it is very rough atm

pablodawson avatar Mar 13 '24 03:03 pablodawson

There is a trick to improve temporal consistency.

Please check out our tutorial on Diffusers for details.

markkua avatar Jun 02 '24 21:06 markkua