k-diffusion icon indicating copy to clipboard operation
k-diffusion copied to clipboard

About missing "ctx" argument in autograd function "ApplyRotaryEmbeddingInplace"

Open sairights opened this issue 5 months ago • 0 comments

Thanks for opensourcing your great work HDiT! In https://github.com/crowsonkb/k-diffusion/blob/21d12c91ad4550e8fcf3308ff9fe7116b3f19a08/k_diffusion/models/image_transformer_v2.py#L204, it seems that the ctx is missing. But strangely, the function could run smoothly without the ctx argument on PyTorch 2.1. As I switch to PyTorch-1.12, the code is not runnable. I am wondering about the reason...

sairights avatar Aug 30 '24 09:08 sairights