Question about the training device on text2image

[zhaowt61]

Thanks for the excellent work! I wonder about the training device on text2image. The paper says it is trained on a single A100, but it seems the settings in table 15 should take more than 640GB of memory. Looking forward to your reply!

[zhangqizky]

真的很奇怪，按照作者的配置，训LSUN churche，根本无法训出来，把学习率减小才可以