Xiashangning

Around 1.7T

+1, I also encountered this problem. When training generative model, I would like to keep en eye on the generative ability of the model along the training process.(Is it degrading,...

Hi, sorry to bring this old issue up again. @muellerzr @Ethan-yt I have experienced the same problem. My code is a little different from theirs. Instead of exhausting the entire...

Hi, right now I figured out a way to bypass this tracking mechanism while still having distributed validation. Here is my ugly hack code: ``` def patch_val_loader(loader): ori_begin_method = loader.begin...