DynamiCrafter icon indicating copy to clipboard operation
DynamiCrafter copied to clipboard

About the loss

Open LeningWang opened this issue 1 year ago • 3 comments

How does the loss function behave, and after how many steps train can we generate an image instead of noise? Thanks!

LeningWang avatar Sep 04 '24 03:09 LeningWang

Hi, since we build our model based on pre-trained t2v model VideoCrafter. it can already generate videos at the beginning.

Doubiiu avatar Sep 04 '24 03:09 Doubiiu

Thank you! If I use the base architecture of DynamiCrafter to train on our own dataset without using the existing pre-trained parameters, is that feasible? Approximately how many steps would the training take? Thanks again!

LeningWang avatar Sep 04 '24 03:09 LeningWang

Emmm I am not sure. Usually, we will train models on pre-trained weights to make our life easier.

Doubiiu avatar Sep 04 '24 23:09 Doubiiu