gemma.cpp icon indicating copy to clipboard operation
gemma.cpp copied to clipboard

Failed on raspberry pi OS (64bit)

Open long568 opened this issue 1 year ago • 5 comments

[  0%] Building CXX object _deps/sentencepiece-build/src/CMakeFiles/sentencepiece.dir/__/third_party/protobuf-lite/arena.cc.o
[  0%] Building CXX object _deps/sentencepiece-build/src/CMakeFiles/sentencepiece.dir/__/third_party/protobuf-lite/arenastring.cc.o
[  3%] Building CXX object _deps/sentencepiece-build/src/CMakeFiles/sentencepiece.dir/__/third_party/protobuf-lite/bytestream.cc.o
[  3%] Building CXX object _deps/sentencepiece-build/src/CMakeFiles/sentencepiece.dir/__/third_party/protobuf-lite/coded_stream.cc.o
[  7%] Building CXX object _deps/sentencepiece-build/src/CMakeFiles/sentencepiece.dir/__/third_party/protobuf-lite/common.cc.o
[  7%] Building CXX object _deps/sentencepiece-build/src/CMakeFiles/sentencepiece.dir/__/third_party/protobuf-lite/extension_set.cc.o
[  7%] Building CXX object _deps/sentencepiece-build/src/CMakeFiles/sentencepiece.dir/__/third_party/protobuf-lite/generated_enum_util.cc.o
[ 11%] Building CXX object _deps/sentencepiece-build/src/CMakeFiles/sentencepiece.dir/__/third_party/protobuf-lite/generated_message_table_driven_lite.cc.o
[ 11%] Building CXX object _deps/sentencepiece-build/src/CMakeFiles/sentencepiece.dir/__/third_party/protobuf-lite/generated_message_util.cc.o
[ 11%] Building CXX object _deps/sentencepiece-build/src/CMakeFiles/sentencepiece.dir/__/third_party/protobuf-lite/implicit_weak_message.cc.o
[ 15%] Building CXX object _deps/sentencepiece-build/src/CMakeFiles/sentencepiece.dir/__/third_party/protobuf-lite/int128.cc.o
[ 15%] Building CXX object _deps/sentencepiece-build/src/CMakeFiles/sentencepiece.dir/__/third_party/protobuf-lite/io_win32.cc.o
[ 15%] Building CXX object _deps/sentencepiece-build/src/CMakeFiles/sentencepiece.dir/__/third_party/protobuf-lite/message_lite.cc.o
[ 19%] Building CXX object _deps/sentencepiece-build/src/CMakeFiles/sentencepiece.dir/__/third_party/protobuf-lite/parse_context.cc.o
[ 19%] Building CXX object _deps/sentencepiece-build/src/CMakeFiles/sentencepiece.dir/__/third_party/protobuf-lite/repeated_field.cc.o
[ 19%] Building CXX object _deps/sentencepiece-build/src/CMakeFiles/sentencepiece.dir/__/third_party/protobuf-lite/status.cc.o
[ 23%] Building CXX object _deps/sentencepiece-build/src/CMakeFiles/sentencepiece.dir/__/third_party/protobuf-lite/statusor.cc.o
[ 23%] Building CXX object _deps/sentencepiece-build/src/CMakeFiles/sentencepiece.dir/__/third_party/protobuf-lite/stringpiece.cc.o
[ 23%] Building CXX object _deps/sentencepiece-build/src/CMakeFiles/sentencepiece.dir/__/third_party/protobuf-lite/stringprintf.cc.o
[ 26%] Building CXX object _deps/sentencepiece-build/src/CMakeFiles/sentencepiece.dir/__/third_party/protobuf-lite/structurally_valid.cc.o
[ 26%] Building CXX object _deps/sentencepiece-build/src/CMakeFiles/sentencepiece.dir/__/third_party/protobuf-lite/strutil.cc.o
[ 26%] Building CXX object _deps/sentencepiece-build/src/CMakeFiles/sentencepiece.dir/__/third_party/protobuf-lite/time.cc.o
[ 30%] Building CXX object _deps/sentencepiece-build/src/CMakeFiles/sentencepiece.dir/__/third_party/protobuf-lite/wire_format_lite.cc.o
[ 30%] Building CXX object _deps/sentencepiece-build/src/CMakeFiles/sentencepiece.dir/__/third_party/protobuf-lite/zero_copy_stream.cc.o
[ 30%] Building CXX object _deps/sentencepiece-build/src/CMakeFiles/sentencepiece.dir/__/third_party/protobuf-lite/zero_copy_stream_impl.cc.o
[ 34%] Building CXX object _deps/sentencepiece-build/src/CMakeFiles/sentencepiece.dir/__/third_party/protobuf-lite/zero_copy_stream_impl_lite.cc.o
[ 34%] Building CXX object _deps/sentencepiece-build/src/CMakeFiles/sentencepiece.dir/builtin_pb/sentencepiece.pb.cc.o
[ 34%] Building CXX object _deps/sentencepiece-build/src/CMakeFiles/sentencepiece.dir/builtin_pb/sentencepiece_model.pb.cc.o
[ 38%] Building CXX object _deps/sentencepiece-build/src/CMakeFiles/sentencepiece.dir/bpe_model.cc.o
[ 38%] Building CXX object _deps/sentencepiece-build/src/CMakeFiles/sentencepiece.dir/char_model.cc.o
[ 42%] Building CXX object _deps/sentencepiece-build/src/CMakeFiles/sentencepiece.dir/error.cc.o
[ 42%] Building CXX object _deps/sentencepiece-build/src/CMakeFiles/sentencepiece.dir/filesystem.cc.o
[ 42%] Building CXX object _deps/sentencepiece-build/src/CMakeFiles/sentencepiece.dir/model_factory.cc.o
[ 46%] Building CXX object _deps/sentencepiece-build/src/CMakeFiles/sentencepiece.dir/model_interface.cc.o
[ 46%] Building CXX object _deps/sentencepiece-build/src/CMakeFiles/sentencepiece.dir/normalizer.cc.o
[ 46%] Building CXX object _deps/sentencepiece-build/src/CMakeFiles/sentencepiece.dir/sentencepiece_processor.cc.o
[ 50%] Building CXX object _deps/sentencepiece-build/src/CMakeFiles/sentencepiece.dir/unigram_model.cc.o
[ 50%] Building CXX object _deps/sentencepiece-build/src/CMakeFiles/sentencepiece.dir/util.cc.o
[ 50%] Building CXX object _deps/sentencepiece-build/src/CMakeFiles/sentencepiece.dir/word_model.cc.o
[ 53%] Building CXX object _deps/sentencepiece-build/src/CMakeFiles/sentencepiece.dir/__/third_party/absl/flags/flag.cc.o
[ 53%] Linking CXX shared library libsentencepiece.so
[ 53%] Built target sentencepiece
[ 53%] Building CXX object _deps/highway-build/CMakeFiles/hwy.dir/hwy/aligned_allocator.cc.o
[ 57%] Building CXX object _deps/highway-build/CMakeFiles/hwy.dir/hwy/nanobenchmark.cc.o
[ 57%] Building CXX object _deps/highway-build/CMakeFiles/hwy.dir/hwy/per_target.cc.o
[ 57%] Building CXX object _deps/highway-build/CMakeFiles/hwy.dir/hwy/print.cc.o
[ 61%] Building CXX object _deps/highway-build/CMakeFiles/hwy.dir/hwy/targets.cc.o
[ 61%] Building CXX object _deps/highway-build/CMakeFiles/hwy.dir/hwy/timer.cc.o
[ 61%] Linking CXX static library libhwy.a
[ 61%] Built target hwy
[ 61%] Building CXX object _deps/highway-build/CMakeFiles/hwy_contrib.dir/hwy/contrib/sort/vqsort_128a.cc.o
[ 65%] Building CXX object _deps/highway-build/CMakeFiles/hwy_contrib.dir/hwy/contrib/sort/vqsort_128d.cc.o
[ 65%] Building CXX object _deps/highway-build/CMakeFiles/hwy_contrib.dir/hwy/contrib/sort/vqsort_f16a.cc.o
[ 65%] Building CXX object _deps/highway-build/CMakeFiles/hwy_contrib.dir/hwy/contrib/sort/vqsort_f16d.cc.o
[ 69%] Building CXX object _deps/highway-build/CMakeFiles/hwy_contrib.dir/hwy/contrib/sort/vqsort_f32a.cc.o
[ 69%] Building CXX object _deps/highway-build/CMakeFiles/hwy_contrib.dir/hwy/contrib/sort/vqsort_f32d.cc.o
[ 73%] Building CXX object _deps/highway-build/CMakeFiles/hwy_contrib.dir/hwy/contrib/sort/vqsort_f64a.cc.o
[ 73%] Building CXX object _deps/highway-build/CMakeFiles/hwy_contrib.dir/hwy/contrib/sort/vqsort_f64d.cc.o
[ 73%] Building CXX object _deps/highway-build/CMakeFiles/hwy_contrib.dir/hwy/contrib/sort/vqsort_i16a.cc.o
[ 76%] Building CXX object _deps/highway-build/CMakeFiles/hwy_contrib.dir/hwy/contrib/sort/vqsort_i16d.cc.o
[ 76%] Building CXX object _deps/highway-build/CMakeFiles/hwy_contrib.dir/hwy/contrib/sort/vqsort_i32a.cc.o
[ 76%] Building CXX object _deps/highway-build/CMakeFiles/hwy_contrib.dir/hwy/contrib/sort/vqsort_i32d.cc.o
[ 80%] Building CXX object _deps/highway-build/CMakeFiles/hwy_contrib.dir/hwy/contrib/sort/vqsort_i64a.cc.o
[ 80%] Building CXX object _deps/highway-build/CMakeFiles/hwy_contrib.dir/hwy/contrib/sort/vqsort_i64d.cc.o
[ 80%] Building CXX object _deps/highway-build/CMakeFiles/hwy_contrib.dir/hwy/contrib/sort/vqsort_kv128a.cc.o
[ 84%] Building CXX object _deps/highway-build/CMakeFiles/hwy_contrib.dir/hwy/contrib/sort/vqsort_kv128d.cc.o
[ 84%] Building CXX object _deps/highway-build/CMakeFiles/hwy_contrib.dir/hwy/contrib/sort/vqsort_kv64a.cc.o
[ 84%] Building CXX object _deps/highway-build/CMakeFiles/hwy_contrib.dir/hwy/contrib/sort/vqsort_kv64d.cc.o
[ 88%] Building CXX object _deps/highway-build/CMakeFiles/hwy_contrib.dir/hwy/contrib/sort/vqsort_u16a.cc.o
[ 88%] Building CXX object _deps/highway-build/CMakeFiles/hwy_contrib.dir/hwy/contrib/sort/vqsort_u16d.cc.o
[ 88%] Building CXX object _deps/highway-build/CMakeFiles/hwy_contrib.dir/hwy/contrib/sort/vqsort_u32a.cc.o
[ 92%] Building CXX object _deps/highway-build/CMakeFiles/hwy_contrib.dir/hwy/contrib/sort/vqsort_u32d.cc.o
[ 92%] Building CXX object _deps/highway-build/CMakeFiles/hwy_contrib.dir/hwy/contrib/sort/vqsort_u64a.cc.o
[ 92%] Building CXX object _deps/highway-build/CMakeFiles/hwy_contrib.dir/hwy/contrib/sort/vqsort_u64d.cc.o
[ 96%] Building CXX object _deps/highway-build/CMakeFiles/hwy_contrib.dir/hwy/contrib/image/image.cc.o
[ 96%] Building CXX object _deps/highway-build/CMakeFiles/hwy_contrib.dir/hwy/contrib/sort/vqsort.cc.o
[ 96%] Linking CXX static library libhwy_contrib.a
[ 96%] Built target hwy_contrib
[ 96%] Building CXX object CMakeFiles/gemma.dir/run.cc.o
[100%] Building CXX object CMakeFiles/gemma.dir/gemma.cc.o
In file included from /home/lo/dbot/gemma.cpp/./gemma.cc:27,
                 from /home/lo/dbot/gemma.cpp/build/_deps/highway-src/hwy/foreach_target.h:174,
                 from /home/lo/dbot/gemma.cpp/gemma.cc:22:
/home/lo/dbot/gemma.cpp/./ops.h: In function ‘float gcpp::N_SVE::SquaredL2(const float*, size_t)’:
/home/lo/dbot/gemma.cpp/./ops.h:352:12: error: ‘MulAdd’ was not declared in this scope
  352 |     sum0 = MulAdd(a0, a0, sum0);
/home/lo/dbot/gemma.cpp/./ops.h:352:12: note: suggested alternatives:
In file included from /home/lo/dbot/gemma.cpp/build/_deps/highway-src/hwy/highway.h:432,
                 from /home/lo/dbot/gemma.cpp/./compression/sfp-inl.h:37,
                 from /home/lo/dbot/gemma.cpp/./compression/nuq-inl.h:41,
                 from /home/lo/dbot/gemma.cpp/./compression/compress-inl.h:48,
                 from /home/lo/dbot/gemma.cpp/./gemma.cc:25,
                 from /home/lo/dbot/gemma.cpp/build/_deps/highway-src/hwy/foreach_target.h:163:
/home/lo/dbot/gemma.cpp/build/_deps/highway-src/hwy/ops/arm_neon-inl.h:2492:22: note:   ‘hwy::N_NEON::MulAdd’
 2492 | HWY_API Vec128<T, N> MulAdd(Vec128<T, N> mul, Vec128<T, N> x,
      |                      ^~~~~~
In file included from /home/lo/dbot/gemma.cpp/build/_deps/highway-src/hwy/highway.h:435,
                 from /home/lo/dbot/gemma.cpp/./compression/sfp-inl.h:37,
                 from /home/lo/dbot/gemma.cpp/./compression/nuq-inl.h:41,
                 from /home/lo/dbot/gemma.cpp/./compression/compress-inl.h:48,
                 from /home/lo/dbot/gemma.cpp/./gemma.cc:25:
……
gmake[3]: *** [CMakeFiles/gemma.dir/build.make:90: CMakeFiles/gemma.dir/gemma.cc.o] Error 1
gmake[2]: *** [CMakeFiles/Makefile2:377: CMakeFiles/gemma.dir/all] Error 2
gmake[1]: *** [CMakeFiles/Makefile2:384: CMakeFiles/gemma.dir/rule] Error 2
gmake: *** [Makefile:189: gemma] Error 2

Many error reports point to the same problem: error: ‘MulAdd’ was not declared in this scope or error: ‘Add’ was not declared in this scope I checked highway's code and MulAdd seems to exist, so I'm not sure why the error "not declared" is reported. Help me pls.

long568 avatar Mar 20 '24 12:03 long568

Thanks for reporting. This is an error in our code, we are missing the hn:: prefix, sorry about that. I'm fixing most of them, to avoid a merge conflict I'd recommend patching in #105, or waiting until that lands (soon).

jan-wassenberg avatar Mar 20 '24 13:03 jan-wassenberg

I found armv8 support sve and neon, so I need to decide which one to use.

long568 avatar Mar 20 '24 13:03 long568

Thanks for reporting. This is an error in our code, we are missing the hn:: prefix, sorry about that. I'm fixing most of them, to avoid a merge conflict I'd recommend patching in #105, or waiting until that lands (soon).

Thx

long568 avatar Mar 20 '24 13:03 long568

Thanks for reporting. This is an error in our code, we are missing the hn:: prefix, sorry about that. I'm fixing most of them, to avoid a merge conflict I'd recommend patching in #105, or waiting until that lands (soon).

Sorry I made mistakes, should I add it in #105 ? I am asking because I have seen a fix p.r.

@jan-wassenberg do you mind if I add gh action to check build on different arch (run-on-arch-action)

enum-class avatar Mar 21 '24 02:03 enum-class

should I add it in https://github.com/google/gemma.cpp/pull/105 ? I am asking because I have seen a fix p.r.

No worries! You mean #113? I was intending not to conflict with the changes in your #105, so yes, please update #105 with hn:: in the new code :)

@jan-wassenberg do you mind if I add gh action to check build on different arch

Great idea, please do! We can do something similar to github.com/google/highway, let's keep in mind that there is a deadline of about 6-7 minutes after which our internal CI times out, so hopefully the runs will finish before that.

jan-wassenberg avatar Mar 21 '24 02:03 jan-wassenberg

I think this is now fixed. Please reopen if you are still seeing an issue.

jan-wassenberg avatar Apr 09 '24 19:04 jan-wassenberg