RFdiffusion icon indicating copy to clipboard operation
RFdiffusion copied to clipboard

How to do self-conditioning?

Open KatarinaYuan opened this issue 1 year ago • 2 comments

Hi, I noticed that in the paper, you mentioned that self-conditioning is quite important for RFdiffusion. Wondering if you could provide an example of implementation for us to follow? Thank you!

KatarinaYuan avatar Aug 01 '23 15:08 KatarinaYuan

What RFdiffusion is done: image

  1. Generate $x^{t+\Delta}$;
  2. Employ ReversteStep to generate $x^{t}$;
  3. Use RFdiffusion to predict $\tilde{x}_0$ and stop gradient;
  4. Use $x^{t}$ and $\tilde{x}_0$ as input of RFdiffusion to predict $x^{pred}$.

v-shaoningli avatar Aug 02 '23 07:08 v-shaoningli

@v-shaoningli created a discussion (https://github.com/RosettaCommons/RFdiffusion/discussions/98). I think we wonder similar questions: (1) whether the simplified implementation adopted by bit diffusion would hurt the performance for RFDiffusion (2) whether this is the reason RFDiffusion chooses this more complicated way of implementation and how much performance loss it would cause

Thank you in advance!

KatarinaYuan avatar Aug 02 '23 19:08 KatarinaYuan