BitNet
BitNet copied to clipboard
AttributeError: TL1 , when building the project on MacOS , M1 device.
I'm using :
- MacOS Ventura 13.2.1
- MacBook Air M1
When I execute the command :
python setup_env.py --hf-repo HF1BitLLM/Llama3-8B-1.58-100B-tokens -q i2_s
I got the message:
INFO:root:Compiling the code using CMake.
INFO:root:Downloading model HF1BitLLM/Llama3-8B-1.58-100B-tokens from HuggingFace to models/Llama3-8B-1.58-100B-tokens...
INFO:root:Converting HF model to GGUF format...
ERROR:root:Error occurred while running command: Command '['/opt/homebrew/anaconda3/envs/bitnet-cpp/bin/python3', 'utils/convert-hf-to-gguf-bitnet.py', 'models/Llama3-8B-1.58-100B-tokens', '--outtype', 'f32']' returned non-zero exit status 1., check details in logs/convert_to_f32_gguf.log
then I execute the command directly :
python utils/convert-hf-to-gguf-bitnet.py models/Llama3-8B-1.58-100B-tokens --outtype f32
I got a AttributeError:
Traceback (most recent call last):
File "/Users/doggingdog/workplace/py_workplace/BitNet/utils/convert-hf-to-gguf-bitnet.py", line 1083, in <module>
"tl1" : gguf.GGMLQuantizationType.TL1,
File "/opt/homebrew/anaconda3/envs/bitnet-cpp/lib/python3.9/enum.py", line 429, in __getattr__
raise AttributeError(name) from None
AttributeError: TL1
Did I miss something ? Has anybody try Bitnet on Mac and got the same problem ?