Tianle Gu
Tianle Gu
运行过程中，好像需要将G.to_device("cuda")改为G=G.to_device("cuda")，否则会报错RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu! (when checking argument for argument index in method wrapper__index_select)。不知道是不是我自己的原因。
When I just import this module, I encounter this: File "test.py", line 1, in from flash_attn.layers.rotary import RotaryEmbedding File "/mnt/petrelfs/gutianle/miniconda3/lib/python3.8/site-packages/flash_attn/layers/rotary.py", line 10, in import rotary_emb ModuleNotFoundError: No module named 'rotary_emb'