Inference issue using pre-trained models

[GuptaSonam]

Hi, Great Work! I was using the pre_trained model for inference on skytimelapse and ucf-101 dataset. However in both the cases, gray videos are generated. I have not made any changes to the code. There are no errors or warnings. Did you face any similar issue ?

https://user-images.githubusercontent.com/8327102/197849735-85ae085f-0eb8-4f88-818c-49a42248689c.mp4