fast-llama icon indicating copy to clipboard operation
fast-llama copied to clipboard

Cannot build

Open AlpinDale opened this issue 2 years ago • 1 comments

Hi, I've been trying to compile the RapidLLaMA, but it seems to have issues. Is the repo still incomplete? I also had to manually build sleef with the test units omitted, as sleef doesn't work with the latest versions of mpfr, so it may be a good idea to mention that (unless it's fixed upstream).

The error I'm getting at the moment is:

/home/alpindale/AI-Stuff/tools/RapidLLaMA/src/utils/utility.h:25:10: error: ‘unique_ptr’ is not a member of ‘std’
   25 |     std::unique_ptr<char[]> buf(new char[size]);
      |          ^~~~~~~~~~
/home/alpindale/AI-Stuff/tools/RapidLLaMA/src/utils/utility.h:18:1: note: ‘std::unique_ptr’ is defined in header ‘<memory>’; did you forget to ‘#include <memory>’?
   17 | #include <iomanip>
  +++ |+#include <memory>
   18 |
/home/alpindale/AI-Stuff/tools/RapidLLaMA/src/utils/utility.h:25:21: error: expected primary-expression before ‘char’
   25 |     std::unique_ptr<char[]> buf(new char[size]);
      |                     ^~~~
Failed

AlpinDale avatar Nov 07 '23 20:11 AlpinDale

lco@rtx:~/Programming/git/fast-llama$ bash ./build.sh
g++ -o ./main ./src/utils/console.cpp ./src/utils/utility.cpp ./src/utils/ftdebug.cpp ./src/platforms/arch/x86_simd.cpp ./src/platforms/arch/arm_simd.cpp ./src/main.cpp ./src/blas/tf_operators.cpp ./src/blas/quant_operators.cpp ./src/transformer/tokenizer.cpp ./src/transformer/sampler.cpp ./src/transformer/transformer.cpp ./src/model_loaders/llama2c_loader.cpp ./src/model_loaders/flm_loader.cpp ./src/model_loaders/gguf_loader.cpp ./src/model_loaders/model_loader.cpp ./src/components/tensor.cpp  -std=c++20 -mavx2  -D_GNU_SOURCE -DDISABLE_NUMA -Wall -lpthread -lm -I./src/blas -I./src/components -I./src/ftl -I./src/model_loaders -I./src/platforms/arch -I./src/platforms/sys -I./src/transformer -I./src/utils  -O3
In file included from ./src/utils/utility.cpp:12:
./src/utils/utility.h: In function ‘std::string cpuft::format(const char*, Args ...)’:
./src/utils/utility.h:38:10: error: ‘unique_ptr’ is not a member of ‘std’
   38 |     std::unique_ptr<char[]> buf(new char[size]);
      |          ^~~~~~~~~~
./src/utils/utility.h:18:1: note: ‘std::unique_ptr’ is defined in header ‘<memory>’; did you forget to ‘#include <memory>’?
   17 | #include <iomanip>
  +++ |+#include <memory>
   18 | 
./src/utils/utility.h:38:21: error: expected primary-expression before ‘char’
   38 |     std::unique_ptr<char[]> buf(new char[size]);
      |                     ^~~~

same problem here on Debian Bookworm

gnusupport avatar Mar 15 '25 18:03 gnusupport