BitNet icon indicating copy to clipboard operation
BitNet copied to clipboard

llama-cpp not working

Open PrinceSajjadHussain opened this issue 8 months ago • 4 comments

Hello The readMe advises to Launch setup_env python script, that will recompile llama-cpp-cli exécutable. I want to easily integrate the optimized new llama-cpp in a gradio or streamlit python app: how to proceed ? (As i can’t use Transformers python api since performances are lower, as explained from Hugging Face page). Do I need to recompile llama-cpp (and then python bindings ), and if yes, how to benefit from all the 1-bit (bitNet) of this repo ? Thanks

PrinceSajjadHussain avatar Apr 22 '25 17:04 PrinceSajjadHussain

I am facing issues with setup_env as well. with errors logged : D:\bitnet\BitNet\3rdparty\llama.cpp\common\common.cpp(445,32): error : no type named 'system_clock' in namespace 'std::chrono' [D:\bitnet\BitNet\build\3rdparty\llama.cpp\common\common.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\common\common.cpp(447,11): error : 'clock' is not a class, namespace, or enumeration [D:\bitnet\BitNet\build\3rdparty\llama.cpp\common\common.vcxproj]

hadeelsharaf avatar Apr 23 '25 21:04 hadeelsharaf

I am facing issues with setup_env as well. with errors logged : D:\bitnet\BitNet\3rdparty\llama.cpp\common\common.cpp(445,32): error : no type named 'system_clock' in namespace 'std::chrono' [D:\bitnet\BitNet\build\3rdparty\llama.cpp\common\common.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\common\common.cpp(447,11): error : 'clock' is not a class, namespace, or enumeration [D:\bitnet\BitNet\build\3rdparty\llama.cpp\common\common.vcxproj]

Please refer to the FAQ section, the errors are introduced by latest llama.cpp, and the solution is provided in the FAQ.

sd983527 avatar Apr 24 '25 04:04 sd983527

I am facing issues with setup_env as well. with errors logged : D:\bitnet\BitNet\3rdparty\llama.cpp\common\common.cpp(445,32): error : no type named 'system_clock' in namespace 'std::chrono' [D:\bitnet\BitNet\build\3rdparty\llama.cpp\common\common.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\common\common.cpp(447,11): error : 'clock' is not a class, namespace, or enumeration [D:\bitnet\BitNet\build\3rdparty\llama.cpp\common\common.vcxproj]

Please refer to the FAQ section, the errors are introduced by latest llama.cpp, and the solution is provided in the FAQ.

the issue is still happening after running git submodule update --remote .\3rdparty\llama.cpp

does this still happen with any one else

latest logs : `MSBuild version 17.13.19+0d9f5a35a for .NET Framework

1>Checking Build System Generating build details from Git -- Found Git: C:/Program Files/Git/cmd/git.exe (found version "2.46.0.windows.1") Building Custom Rule D:/bitnet/BitNet/3rdparty/llama.cpp/common/CMakeLists.txt build_info.vcxproj -> D:\bitnet\BitNet\build\3rdparty\llama.cpp\common\build_info.dir\Release\build_info.lib Building Custom Rule D:/bitnet/BitNet/3rdparty/llama.cpp/ggml/src/CMakeLists.txt D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml.c(12736,29): warning : incompatible pointer types initializing 'bitnet_float_type *' (aka 'float *') with an expression of type 'char *' [-Wincompatible-pointer-types] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml.c(12740,18): warning : initializing 'int8_t *' (aka 'signed char *') with an expression of type 'char *' converts between pointers to integer types where one is of the unique plain 'char' type and the other is not [-Wpointer-sign] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml.c(12757,42): warning : passing 'const struct ggml_tensor *' to parameter of type 'struct ggml_tensor *' discards qualifiers [-Wincompatible-pointer-types-discards-qualifiers] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src........\include\ggml-bitnet.h(35,65): message : passing argument to parameter 'tensor' here [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml.c(12761,51): warning : incompatible pointer types passing 'bitnet_float_type *' (aka 'float *') to parameter of type 'ggml_fp16_t *' (aka 'unsigned short *') [-Wincompatible-pointer-types] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml.c(541,59): message : passing argument to parameter 'y' here [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] In file included from D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml.c:5: D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml-impl.h(154,15): warning : unused function 'ggml_hash_find_or_insert' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml.c(148,12): warning : unused function 'pthread_create' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml.c(160,12): warning : unused function 'pthread_join' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml.c(2330,20): warning : unused function 'ggml_vec_dot_f16_unroll' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml.c(2585,20): warning : unused function 'ggml_vec_gelu_f16' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml.c(3236,20): warning : unused function 'ggml_thread_cpu_relax' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml.c(3343,17): warning : unused function 'ggml_get_numa_affinity' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml.c(3745,19): warning : unused function 'ggml_up32' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml.c(20026,21): warning : unused function 'ggml_graph_compute_secondary_thread' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml.c(20066,13): warning : unused function 'ggml_thread_apply_priority' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml.c(20194,13): warning : unused function 'ggml_thread_cpumask_is_valid' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml.c(20201,13): warning : unused function 'ggml_thread_cpumask_next' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml.c(21560,13): warning : unused function 'ggml_opt_get_grad' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] In file included from D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml-alloc.c:4: D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml-impl.h(59,15): warning : unused function 'ggml_bitset_size' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml-impl.h(128,13): warning : unused function 'ggml_hash_contains' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml-impl.h(133,15): warning : unused function 'ggml_hash_insert' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml-alloc.c(470,13): warning : unused function 'ggml_gallocr_set_node_offset' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] In file included from D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml-quants.c:5: D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml-impl.h(59,15): warning : unused function 'ggml_bitset_size' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml-impl.h(128,13): warning : unused function 'ggml_hash_contains' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml-impl.h(133,15): warning : unused function 'ggml_hash_insert' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml-impl.h(154,15): warning : unused function 'ggml_hash_find_or_insert' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml-quants.c(35,23): warning : unused function 'mul_sum_i8_pairs' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml-quants.c(66,19): warning : unused function 'hsum_i32_4' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml-quants.c(131,23): warning : unused function 'packNibbles' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml-quants.c(1774,14): warning : unused function 'make_qkx1_quants' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml-quants.c(14850,12): warning : unused function 'iq1_find_best_neighbour' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] In file included from D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml-aarch64.c:9: D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml-impl.h(59,15): warning : unused function 'ggml_bitset_size' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml-impl.h(128,13): warning : unused function 'ggml_hash_contains' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml-impl.h(133,15): warning : unused function 'ggml_hash_insert' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml-impl.h(154,15): warning : unused function 'ggml_hash_find_or_insert' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] In file included from D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml-backend.cpp:13: D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml-impl.h(59,15): warning : unused function 'ggml_bitset_size' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\ggml-impl.h(128,13): warning : unused function 'ggml_hash_contains' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] In file included from D:\bitnet\BitNet\src\ggml-bitnet-lut.cpp:10: D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src........\include\bitnet-lut-kernels.h(1127,54): warning : 'backend' is deprecated: use the buffer type to find the storage location of the tensor [-Wdeprecated-declarations] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src..\include\ggml.h(585,9): message : 'backend' has been explicitly marked deprecated here [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src..\include\ggml.h(194,52): message : expanded from macro 'GGML_DEPRECATED' [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\src\ggml-bitnet-lut.cpp(137,15): warning : 'backend' is deprecated: use the buffer type to find the storage location of the tensor [-Wdeprecated-declarations] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src..\include\ggml.h(585,9): message : 'backend' has been explicitly marked deprecated here [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src..\include\ggml.h(194,52): message : expanded from macro 'GGML_DEPRECATED' [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] In file included from D:\bitnet\BitNet\src\ggml-bitnet-lut.cpp:10: D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src........\include\bitnet-lut-kernels.h(279,19): warning : unused variable 'vec_sign_mask' [-Wunused-variable] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src........\include\bitnet-lut-kernels.h(1046,17): message : in instantiation of function template specialization 'three_qgemm_lut_3200_8640<1>' requested here [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src........\include\bitnet-lut-kernels.h(280,19): warning : unused variable 'vec_zero' [-Wunused-variable] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src........\include\bitnet-lut-kernels.h(281,19): warning : unused variable 'vec_one' [-Wunused-variable] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src........\include\bitnet-lut-kernels.h(523,19): warning : unused variable 'vec_sign_mask' [-Wunused-variable] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src........\include\bitnet-lut-kernels.h(1078,17): message : in instantiation of function template specialization 'three_qgemm_lut_3200_3200<1>' requested here [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src........\include\bitnet-lut-kernels.h(524,19): warning : unused variable 'vec_zero' [-Wunused-variable] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src........\include\bitnet-lut-kernels.h(525,19): warning : unused variable 'vec_one' [-Wunused-variable] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src........\include\bitnet-lut-kernels.h(767,19): warning : unused variable 'vec_sign_mask' [-Wunused-variable] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src........\include\bitnet-lut-kernels.h(1110,17): message : in instantiation of function template specialization 'three_qgemm_lut_8640_3200<1>' requested here [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src........\include\bitnet-lut-kernels.h(768,19): warning : unused variable 'vec_zero' [-Wunused-variable] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src........\include\bitnet-lut-kernels.h(769,19): warning : unused variable 'vec_one' [-Wunused-variable] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src........\include\bitnet-lut-kernels.h(19,13): warning : unused function 'aligned_free' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src........\include\bitnet-lut-kernels.h(276,13): warning : loop not unrolled: the optimizer was unable to perform the requested transformation; the transformation might be disabled or specified as part of an unsupported transformation ordering [-Wpass-failed=transform-warning] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src........\include\bitnet-lut-kernels.h(657,16): warning : loop not unrolled: the optimizer was unable to perform the requested transformation; the transformation might be disabled or specified as part of an unsupported transformation ordering [-Wpass-failed=transform-warning] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src........\include\bitnet-lut-kernels.h(520,13): warning : loop not unrolled: the optimizer was unable to perform the requested transformation; the transformation might be disabled or specified as part of an unsupported transformation ordering [-Wpass-failed=transform-warning] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src........\include\bitnet-lut-kernels.h(901,16): warning : loop not unrolled: the optimizer was unable to perform the requested transformation; the transformation might be disabled or specified as part of an unsupported transformation ordering [-Wpass-failed=transform-warning] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src........\include\bitnet-lut-kernels.h(764,13): warning : loop not unrolled: the optimizer was unable to perform the requested transformation; the transformation might be disabled or specified as part of an unsupported transformation ordering [-Wpass-failed=transform-warning] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] In file included from D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\llamafile\sgemm.cpp:52: D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src.\ggml-impl.h(59,15): warning : unused function 'ggml_bitset_size' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src.\ggml-impl.h(128,13): warning : unused function 'ggml_hash_contains' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src.\ggml-impl.h(133,15): warning : unused function 'ggml_hash_insert' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src.\ggml-impl.h(154,15): warning : unused function 'ggml_hash_find_or_insert' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\llamafile\sgemm.cpp(80,15): warning : unused function 'add' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\llamafile\sgemm.cpp(81,15): warning : unused function 'sub' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\llamafile\sgemm.cpp(82,15): warning : unused function 'mul' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\llamafile\sgemm.cpp(86,15): warning : unused function 'add' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\llamafile\sgemm.cpp(87,15): warning : unused function 'sub' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\llamafile\sgemm.cpp(88,15): warning : unused function 'mul' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\llamafile\sgemm.cpp(92,15): warning : unused function 'add' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\llamafile\sgemm.cpp(93,15): warning : unused function 'sub' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\llamafile\sgemm.cpp(94,15): warning : unused function 'mul' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\llamafile\sgemm.cpp(213,27): warning : unused function 'load<attribute((vector_size(4 * sizeof(float)))) float, float>' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\llamafile\sgemm.cpp(219,27): warning : unused function 'load<attribute((vector_size(8 * sizeof(float)))) float, float>' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\ggml\src\llamafile\sgemm.cpp(225,27): warning : unused function 'load<attribute((vector_size(8 * sizeof(float)))) float, unsigned short>' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\ggml\src\ggml.vcxproj] Auto build dll exports ggml.vcxproj -> D:\bitnet\BitNet\build\bin\Release\ggml.dll Building Custom Rule D:/bitnet/BitNet/3rdparty/llama.cpp/src/CMakeLists.txt D:\bitnet\BitNet\3rdparty\llama.cpp\src\llama.cpp(16910,13): warning : unused function 'llama_set_s_copy' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\src\llama.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\src\llama-vocab.cpp(114,13): warning : unused function 'llama_is_unknown_token' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\src\llama.vcxproj] In file included from D:\bitnet\BitNet\3rdparty\llama.cpp\src\llama-grammar.cpp:1: In file included from D:\bitnet\BitNet\3rdparty\llama.cpp\src\llama-grammar.h:3: D:\bitnet\BitNet\3rdparty\llama.cpp\src\llama-impl.h(52,13): warning : unused function 'replace_all' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\src\llama.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\src\llama-grammar.cpp(201,13): warning : unused function 'print_rule_binary' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\src\llama.vcxproj] In file included from D:\bitnet\BitNet\3rdparty\llama.cpp\src\llama-sampling.cpp:1: In file included from D:\bitnet\BitNet\3rdparty\llama.cpp\src\llama-sampling.h:5: In file included from D:\bitnet\BitNet\3rdparty\llama.cpp\src\llama-grammar.h:3: D:\bitnet\BitNet\3rdparty\llama.cpp\src\llama-impl.h(52,13): warning : unused function 'replace_all' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\src\llama.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\src\unicode.cpp(29,20): warning : unused function 'unicode_cpts_to_utf8' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\src\llama.vcxproj] Auto build dll exports llama.vcxproj -> D:\bitnet\BitNet\build\bin\Release\llama.dll Building Custom Rule D:/bitnet/BitNet/3rdparty/llama.cpp/examples/llava/CMakeLists.txt D:\bitnet\BitNet\3rdparty\llama.cpp\examples\llava\clip.cpp(1469,13): warning : 'clip_model_load' has a non-throwing exception specification but can still throw [-Wexceptions] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\examples\llava\llava.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\examples\llava\clip.cpp(1031,19): message : function declared non-throwing here [D:\bitnet\BitNet\build\3rdparty\llama.cpp\examples\llava\llava.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\examples\llava\clip.cpp(1041,9): warning : 'clip_model_load' has a non-throwing exception specification but can still throw [-Wexceptions] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\examples\llava\llava.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\examples\llava\clip.cpp(1031,19): message : function declared non-throwing here [D:\bitnet\BitNet\build\3rdparty\llama.cpp\examples\llava\llava.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\examples\llava\clip.cpp(2614,5): warning : 'clip_n_mmproj_embd' has a non-throwing exception specification but can still throw [-Wexceptions] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\examples\llava\llava.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\examples\llava\clip.cpp(2591,5): message : function declared non-throwing here [D:\bitnet\BitNet\build\3rdparty\llama.cpp\examples\llava\llava.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\examples\llava\clip.cpp(275,13): warning : unused function 'print_tensor_info' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\examples\llava\llava.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\examples\llava\clip.cpp(1584,13): warning : unused function 'bilinear_resize' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\examples\llava\llava.vcxproj] llava.vcxproj -> D:\bitnet\BitNet\build\3rdparty\llama.cpp\examples\llava\llava.dir\Release\llava.lib Building Custom Rule D:/bitnet/BitNet/3rdparty/llama.cpp/examples/gguf-hash/CMakeLists.txt sha1.vcxproj -> D:\bitnet\BitNet\build\3rdparty\llama.cpp\examples\gguf-hash\sha1.dir\Release\sha1.lib Building Custom Rule D:/bitnet/BitNet/3rdparty/llama.cpp/examples/gguf-hash/CMakeLists.txt sha256.vcxproj -> D:\bitnet\BitNet\build\3rdparty\llama.cpp\examples\gguf-hash\sha256.dir\Release\sha256.lib Building Custom Rule D:/bitnet/BitNet/3rdparty/llama.cpp/examples/gguf-hash/CMakeLists.txt xxhash.vcxproj -> D:\bitnet\BitNet\build\3rdparty\llama.cpp\examples\gguf-hash\xxhash.dir\Release\xxhash.lib Building Custom Rule D:/bitnet/BitNet/3rdparty/llama.cpp/common/CMakeLists.txt D:\bitnet\BitNet\3rdparty\llama.cpp\common\common.cpp(445,32): error : no type named 'system_clock' in namespace 'std::chrono' [D:\bitnet\BitNet\build\3rdparty\llama.cpp\common\common.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\common\common.cpp(447,11): error : 'clock' is not a class, namespace, or enumeration [D:\bitnet\BitNet\build\3rdparty\llama.cpp\common\common.vcxproj] C:\Program Files (x86)\Windows Kits\10\Include\10.0.19041.0\ucrt\time.h(142,26): message : 'clock' declared here [D:\bitnet\BitNet\build\3rdparty\llama.cpp\common\common.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\common\common.cpp(447,44): error : 'clock' is not a class, namespace, or enumeration [D:\bitnet\BitNet\build\3rdparty\llama.cpp\common\common.vcxproj] C:\Program Files (x86)\Windows Kits\10\Include\10.0.19041.0\ucrt\time.h(142,26): message : 'clock' declared here [D:\bitnet\BitNet\build\3rdparty\llama.cpp\common\common.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\common\common.cpp(448,30): error : 'clock' is not a class, namespace, or enumeration [D:\bitnet\BitNet\build\3rdparty\llama.cpp\common\common.vcxproj] C:\Program Files (x86)\Windows Kits\10\Include\10.0.19041.0\ucrt\time.h(142,26): message : 'clock' declared here [D:\bitnet\BitNet\build\3rdparty\llama.cpp\common\common.vcxproj] Building Custom Rule D:/bitnet/BitNet/3rdparty/llama.cpp/examples/gguf/CMakeLists.txt llama-gguf.vcxproj -> D:\bitnet\BitNet\build\bin\Release\llama-gguf.exe Building Custom Rule D:/bitnet/BitNet/3rdparty/llama.cpp/examples/gguf-hash/CMakeLists.txt llama-gguf-hash.vcxproj -> D:\bitnet\BitNet\build\bin\Release\llama-gguf-hash.exe Building Custom Rule D:/bitnet/BitNet/3rdparty/llama.cpp/examples/quantize-stats/CMakeLists.txt In file included from D:\bitnet\BitNet\3rdparty\llama.cpp\examples\quantize-stats\quantize-stats.cpp:4: D:\bitnet\BitNet\3rdparty\llama.cpp\src.\llama-impl.h(52,13): warning : unused function 'replace_all' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\examples\quantize-stats\llama-quantize-stats.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\examples\quantize-stats\quantize-stats.cpp(134,13): warning : unused function 'tensor_is_contiguous' [-Wunused-function] [D:\bitnet\BitNet\build\3rdparty\llama.cpp\examples\quantize-stats\llama-quantize-stats.vcxproj] llama-quantize-stats.vcxproj -> D:\bitnet\BitNet\build\bin\Release\llama-quantize-stats.exe Building Custom Rule D:/bitnet/BitNet/3rdparty/llama.cpp/examples/simple/CMakeLists.txt llama-simple.vcxproj -> D:\bitnet\BitNet\build\bin\Release\llama-simple.exe Building Custom Rule D:/bitnet/BitNet/3rdparty/llama.cpp/examples/llava/CMakeLists.txt llava_shared.vcxproj -> D:\bitnet\BitNet\build\bin\Release\llava_shared.dll Building Custom Rule D:/bitnet/BitNet/3rdparty/llama.cpp/examples/llava/CMakeLists.txt llava_static.vcxproj -> D:\bitnet\BitNet\build\3rdparty\llama.cpp\examples\llava\Release\llava_static.lib `

hadeelsharaf avatar Apr 25 '25 00:04 hadeelsharaf

I am facing issues with setup_env as well. with errors logged : D:\bitnet\BitNet\3rdparty\llama.cpp\common\common.cpp(445,32): error : no type named 'system_clock' in namespace 'std::chrono' [D:\bitnet\BitNet\build\3rdparty\llama.cpp\common\common.vcxproj] D:\bitnet\BitNet\3rdparty\llama.cpp\common\common.cpp(447,11): error : 'clock' is not a class, namespace, or enumeration [D:\bitnet\BitNet\build\3rdparty\llama.cpp\common\common.vcxproj]

Please refer to the FAQ section, the errors are introduced by latest llama.cpp, and the solution is provided in the FAQ.

After applying the code from the commit mentioned in the FAQ section i needed to apply the same change to another common.cpp to get the issues fixed.

Thanks

hadeelsharaf avatar Apr 25 '25 01:04 hadeelsharaf