Question about DDIM loss

[zyp-byte]

Hi, thanks for your wonderful work! When I was reading the code, I noticed that you took the time embedding on the feature extracted from the RGB images. I am wondering if it is better to take the time embedding on the depth output by the decoder (namely 'refined_depth' defined in your code), or just annotated depth with masks. Thanks for your work and codes again!