TokenFlow icon indicating copy to clipboard operation
TokenFlow copied to clipboard

Why add_noise before sample_loop

Open LiuRicky opened this issue 1 month ago • 0 comments

Thanks for your owesome work.

In run_tokenflow_pnp.py, why using "noisy_latents = self.scheduler.add_noise(self.latents, self.eps, self.scheduler.timesteps[0])" line257 before "edited_frames = self.sample_loop(noisy_latents, torch.arange(self.config["n_frames"]))" line 258.

It seems directly using "edited_frames = self.sample_loop(noisy_latents, torch.arange(self.config["n_frames"]))" is fine since it starts at timestamp 0. And the pnp-diffusers (https://github.com/MichalGeyer/pnp-diffusers, which this project may refer) just use "edited_img = self.sample_loop(self.eps)".

LiuRicky avatar May 14 '24 10:05 LiuRicky