CogVideo icon indicating copy to clipboard operation
CogVideo copied to clipboard

Published 20 hours ago • verified publisher icon THUDM

Compute resources used to train CogVideoX

Open michal-stary opened this issue 1 year ago • 2 comments

Hey, can you share details on how much compute was used to train the CogVideoX models?

michal-stary avatar Sep 02 '24 15:09 michal-stary

More than 100,000 GPU hours of H100 as told in X before

zRzRzRzRzRzRzR avatar Sep 03 '24 02:09 zRzRzRzRzRzRzR

More than 100,000 GPU hours of H100 as told in X before

What are the batchsize and training iterations?

yzhang2016 avatar Sep 11 '24 12:09 yzhang2016

These are limited by the company's requirements, and we are not at liberty to disclose them directly. However, I believe you can estimate based on the data I mentioned; the batch size must be greater than 1024, preferably above 2048.

zRzRzRzRzRzRzR avatar Sep 22 '24 06:09 zRzRzRzRzRzRzR