Set diffusion model to evaluation mode

[DSaurus]

Set the diffusion model to evaluation mode as a precaution. Currently, The training mode and evaluation mode will not affect the model's performance since stable diffusion utilizes GroupNorm in U-Net and LayerNorm in CLIP.