Yue Ding

icon indicating an email [email protected]

icon company Harbin Institute of Technology icon location student of Harbin Institute of Technology@Yue Ding

Results 2 comments of Yue Ding

About the transformers version.

Hi, did solve the problem? I met the same problem with llava vision is `1.1.3` with LLaVA vision is `v1.2.0` transformers `4.36.2` torch `2.0.1`

mha.py array shapes

same question, with the original code in the class `MultiHeadAttention` in mha.py. Cause the following logic, the softmax will operate cross batch, which I don't understand. Need help. ``` #...