bahartaji comments

Repositories
Issues
Comments

Results 1 comments of


                                            bahartaji

Hallucination for Llama3-8B-1.58-100B-tokens model with both i2_s and tl2 quantization

when running "python setup_env.py -md models/Llama3-8B-1.58-100B-tokens -q i2_s" on my windows VM I get this error: Traceback (most recent call last): File "C:\BitNet\setup_env.py", line 202, in main() File "C:\BitNet\setup_env.py", line...