Cannot find cuda-compiled version of RoPE2D

Open nobeldang opened this issue 1 year ago • 1 comments

Hi, whenever I try to use the croco model it says as a warning: "Warning, cannot find cuda-compiled version of RoPE2D, using a slow pytorch version instead." Does this mean that the model is not using the RoPE2D embeddings but rather the cosine embeddings? If so can you provide any suggestions on how to resolve that?

Oct 22 '24 17:10 nobeldang

Hi, no you are still using RoPE2D.

It means you are using this implementation: https://github.com/naver/croco/blob/master/models/pos_embed.py#L110 instead of https://github.com/naver/croco/blob/master/models/curope/curope2d.py#L32

Install instructions are written in the README: https://github.com/naver/croco/tree/master?tab=readme-ov-file#preparation ; 2. Compile cuda kernels for RoPE

Oct 23 '24 06:10 yocabon