Computation Requirement to train CogVideo

Open g1910 opened this issue 3 years ago • 1 comments

Hi,

First of all, great work in developing CogVideo. Could you please provide information on how many GPUs and how much duration it took to train the model?

Thanks Gaurav

Sep 01 '22 20:09 g1910

We use 13*8 A100 to train the model. The two stages were trained for ~100k iterations in total, which took ~20 days.

Sep 10 '22 16:09 wenyihong

How much GPU memory and how much duration it took to infer the model? I have a RTX3090Ti, but OOM occurred.

Oct 27 '22 03:10 xfguo-ucas

Great work! Could you please help me with below issue? How much GPU memory is required for Inferencing? With a 15 GB GPU, I tried it, but a runtime problem appeared.

Dec 12 '22 13:12 AY-Anish-Yadav

It takes around 25GB GPU memory to inference with batchsize=1 (on our A100).

Feb 03 '23 03:02 wenyihong

hi, what's the runtime problem?

Feb 03 '23 03:02 wenyihong