llm2vec icon indicating copy to clipboard operation
llm2vec copied to clipboard

Published 20 hours ago • verified publisher icon McGill-NLP

Possible to train Llama 3.1?

Open mosh98 opened this issue 6 months ago • 7 comments

Hi,

I tried training llama 3.1 with run_mntp.py but get an obsucre error

AttributeError: 'LlamaBiModel' object has no attribute 'rotary_emb'

What is that about ?

mosh98 avatar Jul 30 '24 09:07 mosh98