A question about the pred noise.

[northagain]

Thanks for ur excellent work! I have a question about ddim loss which is computed with noise and pred noise. The pred noise, which is the output of ScheduledCNNRefine Model is >0, because the last activation function is RELU. However, shouldn't the randn noise contains both >0 parts and <0 parts?