[BUG/Help] <rotary相对位置编码和chatglm v1有区别吗>

[Tongjilibo]

Is there an existing issue for this?

• [X] I have searched the existing issues

Current Behavior

看了下代码实现，感觉有chatglm v1的相对位置编码实现方式不同，请教下区别在哪里

Expected Behavior

No response

Steps To Reproduce

同上

Environment

- OS: windows
- Python: 3.10
- Transformers: ...
- PyTorch: 2.0
- CUDA Support (`python -c "import torch; print(torch.cuda.is_available())"`) : True

Anything else?

No response