rulm icon indicating copy to clipboard operation
rulm copied to clipboard

convert_to_native.py 70b support

Open Displacer opened this issue 11 months ago • 0 comments

Is there reasons for not supporting 70b converting?

Are n_heads = 64, dim = 8192 for LLaMa v2 70b correct values?

Displacer avatar Mar 17 '24 13:03 Displacer