Open-Sora-Plan icon indicating copy to clipboard operation
Open-Sora-Plan copied to clipboard

Inquiry of training time for CausalVideoVAE

Open FlyingRoastDuck opened this issue 10 months ago • 1 comments

Thanks for making the amazing work publicly available. I am curious about the total training time for your pre-trained VAE model: https://huggingface.co/LanguageBind/Open-Sora-Plan-v1.0.0/tree/main/vae

How long have you spent to train this model with the 434,000 (as mentioned in the technical report) video clips ?

Moreover, could you please offer more details about how the input parameters affect the training time ? Such as num of frames, batch size, resolution, etc. We can estimate the required computational resources based on your information.

FlyingRoastDuck avatar Apr 15 '24 06:04 FlyingRoastDuck

It takes 1-2 days on the 8 A800 according to our training script.

LinB203 avatar Apr 18 '24 03:04 LinB203