DoubleXING comments

Results 100 comments of


                                            DoubleXING

Can we train with 16 frame and inference 25 frame

Hi. It is possible to generate 32 frames without training as shown in #36, but the results may suffer from some artifacts. I don't recommend doing that in this way.

I fine-tuned on the webvid data set, and the generated videos moved slowly

Please see #84

what factors or parameters might affect the model's motion/dynamic performance during training?

Hi. I was also aware that the motion magnitude of the 512 model is larger than that of 1024's, and doubt the resolution may affect the motion performance. Besides, the...

xformer warning

Hi. I think you should reinstall your xformers based on your current environment and make sure it workable.

In the future, will there be plans to train a frame interpolation model at a resolution of 1024？

Hi. Thanks for your recognition, which is very helpful for open-source projects. Currently, we are focusing on some research topics about interpolation and will do that for 1024x576 if the...

In the future, will there be plans to train a frame interpolation model at a resolution of 1024？

Hi. Did you make it generate longer videos by doing what in #36?

output size question

Yes. Currently, we will preprocess the input images to match the required resolution. If the input/output size is modified (must be a multiplier of 32), the performance may not be...

Do you plan to release the DynamiCrafter1024_interpolation model?

Thanks for your interest. However, we don't plan to do that. Personally, I recommend you to use [ToonCrafter](https://github.com/Doubiiu/ToonCrafter)(better quality) to interpolate (real or cartoon) images at the resolution of 512x320...

Garbage results with frame count <16

Hi. Thanks for your interest. Since the model was trained with the fixed temporal frame length (16), the performance of directly inferring frames

Garbage results with frame count <16

> Here you can see I am using a "frame stride" of 10, which was the default value. I don't really know how that parameter works, but it sounds like...