Yu Kyeongmin(Pheobe)
Results
2
issues of
Yu Kyeongmin(Pheobe)
https://github.com/labmlai/annotated_deep_learning_paper_implementations/blob/f42c0e9cf49eedd003b34bc4e7a58e0157eae332/labml_nn/transformers/rope/__init__.py#L188 `self.cos_cached` and `self.sin_cached` have same shape of `x`, aren't they?? So if this line intended to compute RoPE with partial of x which means `x[...,:self.d]`, i think this line...
python 3.8.16 cuda 11.3 torch 1.12.0 gpu geforce rtx 3090 **with flash-attn 0.2** ` note: This error originates from a subprocess, and is likely not a problem with pip. ERROR:...