BitNet
BitNet copied to clipboard
Infinite compilation when using setup.py
Hi everyone
I got a mac M1 and I tried to build bitnet, everythings ran fine until I ran python setup_env.py -md models/BitNet-b1.58-2B-4T -q i2_s
When I run it, I only got INFO:root:Compiling the code using CMake. and then... nothing for an hour
It only make my computer burn for 1 hour
I checked logs/generate_build_files.log and here what I got :
-- Accelerate framework found
-- Metal framework found
-- OpenMP found
-- BLAS found, Libraries: /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/System/Library/Frameworks/Accelerate.framework
-- BLAS found, Includes:
-- Using llamafile
-- Warning: ccache not found - consider installing it for faster compilation or disable this warning with GGML_CCACHE=OFF
-- CMAKE_SYSTEM_PROCESSOR: arm64
-- ARM detected
-- Configuring done (0.3s)
-- Generating done (0.1s)
-- Build files have been written to: /Users/teo/repo/BitNet/build
So nothing very revelant... here log/compile.log
/Users/teo/repo/BitNet/3rdparty/llama.cpp/ggml/src/../include/ggml.h:585:9: note: 'backend' has been explicitly marked deprecated here
585 | GGML_DEPRECATED(enum ggml_backend_type backend, "use the buffer type to find the storage location of the tensor");
| ^
/Users/teo/repo/BitNet/3rdparty/llama.cpp/ggml/src/../include/ggml.h:192:61: note: expanded from macro 'GGML_DEPRECATED'
192 | # define GGML_DEPRECATED(func, hint) func __attribute__((deprecated(hint)))
| ^
/Users/teo/repo/BitNet/src/ggml-bitnet-lut.cpp:74:15: warning: unused variable 'bits' [-Wunused-variable]
74 | const int bits = ggml_bitnet_get_type_bits(src0->type);
| ^~~~
/Users/teo/repo/BitNet/src/ggml-bitnet-lut.cpp:70:131: warning: unused parameter 'dst' [-Wunused-parameter]
70 | size_t ggml_bitnet_mul_mat_get_wsize(const struct ggml_tensor * src0, const struct ggml_tensor * src1, const struct ggml_tensor * dst) {
|
Just a bunch or warnings, no errors here
logs/codegen.log is empty
I don't really know what happened, seems to be stuck in an infinite loop when compiling, if you have some ideas...