rectified-flow-pytorch
rectified-flow-pytorch copied to clipboard
lucidrains
Implementation of rectified flow and some of its followup research / improvements in Pytorch
Thanks for your excellent code! I'm a bit confused about some of the code in the `rectified_flow.py` file What's the difference between these two ema model? ``` if getattr(self.model, 'use_consistency',...
Hello, I've been reading a lot of the SOTA papers on audio and video generation using Rectified Flows, and it seems most are using Transformers instead of Unets. Are there...
Hello, Thanks so much for open sourcing the code. I have been training an unconditioned RF model on audio latents, with really good quality results. Here's some audio examples: https://drive.google.com/file/d/169NMzxl0k5X8oqiadNs3e7sjlxz8V5Pk/view?usp=sharing...
I've been reading a lot of Flow matching papers recently and I'm a big fan of anything that gets close to optimal transport, like we had with Wasserstein GANs in...
I have tried the new version training on device "mps" Macbook and it is 5x slower than the previous version. The GPU does not seem to utilize 100% because normally...
Hello, I noticed you comment mentioning that Clipping Flow values helped you a lot and default value you set to (-3,3), https://github.com/lucidrains/rectified-flow-pytorch/blob/1f59e7e9122439931968126d4ac662c1f0ce24ac/rectified_flow_pytorch/rectified_flow.py#L159 My question is about the range of Clipping...
Hello, Thankyou for detailed and yet easy to follow implementation of Rectified Flow paper. I was going through the original implementation by authors and the authors use the original LPIPS...
Metadata
Owner
Metadata
Implementation of rectified flow and some of its followup research / improvements in Pytorch