text-embeddings-inference
text-embeddings-inference copied to clipboard
Failed building with cargo
System Info
Ubuntu 20.04 cargo 1.75.0 (1d8b05cdd 2023-11-20) 4xA100
Information
- [ ] Docker
- [X] The CLI directly
Tasks
- [X] An officially supported command
- [ ] My own modifications
Reproduction
curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh
cd text-embeddings-inference
cargo install --path router -F candle-cuda --no-default-features
Error:
Compiling stable_deref_trait v1.2.0
Compiling lazy_static v1.4.0
Compiling openssl v0.10.63
Compiling mime v0.3.17
Compiling base64 v0.21.7
Compiling foreign-types-shared v0.1.1
error: could not compile `memchr` (lib)
Caused by:
process didn't exit successfully: `/root/.rustup/toolchains/1.73.0-x86_64-unknown-linux-gnu/bin/rustc --crate-name memchr --edition=2021 /root/.cargo/registry/src/index.crates.io-6f17d22bba15001f/memchr-2.7.1/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --diagnostic-width=171 --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C panic=abort -C lto=off -C embed-bitcode=no -C debuginfo=1 --cfg 'feature="alloc"' --cfg 'feature="default"' --cfg 'feature="std"' -C metadata=4787abf57b9037bf -C extra-filename=-4787abf57b9037bf --out-dir /mnt/home/search/serving/text-embeddings-inference/target/release/deps -L dependency=/mnt/home/search/serving/text-embeddings-inference/target/release/deps --cap-lints allow -C target-cpu=native` (signal: 7, SIGBUS: access to undefined memory)
warning: build failed, waiting for other jobs to finish...
error: could not compile `vcpkg` (lib)
Caused by:
process didn't exit successfully: `/root/.rustup/toolchains/1.73.0-x86_64-unknown-linux-gnu/bin/rustc --crate-name vcpkg /root/.cargo/registry/src/index.crates.io-6f17d22bba15001f/vcpkg-0.2.15/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --diagnostic-width=171 --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debug-assertions=off -C metadata=4f11aecc207ce7b2 -C extra-filename=-4f11aecc207ce7b2 --out-dir /mnt/home/search/serving/text-embeddings-inference/target/release/deps -L dependency=/mnt/home/search/serving/text-embeddings-inference/target/release/deps --cap-lints allow -C target-cpu=native` (signal: 7, SIGBUS: access to undefined memory)
error: failed to compile `text-embeddings-router v0.6.0 (/mnt/home/search/serving/text-embeddings-inference/router)`, intermediate artifacts can be found at `/mnt/home/search/serving/text-embeddings-inference/target`.
To reuse those artifacts with a future compilation, set the environment variable `CARGO_TARGET_DIR` to that path.
Expected behavior
Install successfully.
It may raise error in different process:
Compiling lazy_static v1.4.0
Compiling openssl v0.10.63
Compiling mime v0.3.17
Compiling base64 v0.21.7
Compiling bitflags v2.4.2
Compiling version_check v0.9.4
Compiling strsim v0.10.0
Compiling num-traits v0.2.17
Compiling lock_api v0.4.11
error: could not compile `memchr` (lib)
Caused by:
process didn't exit successfully: `/root/.rustup/toolchains/1.73.0-x86_64-unknown-linux-gnu/bin/rustc --crate-name memchr --edition=2021 /root/.cargo/registry/src/index.crates.io-6f17d22bba15001f/memchr-2.7.1/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --diagnostic-width=171 --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debug-assertions=off -C metadata=633e5bec155430e2 -C extra-filename=-633e5bec155430e2 --out-dir /mnt/home/search/serving/text-embeddings-inference/target/release/deps -L dependency=/mnt/home/search/serving/text-embeddings-inference/target/release/deps --cap-lints allow -C target-cpu=native` (signal: 7, SIGBUS: access to undefined memory)
warning: build failed, waiting for other jobs to finish...
error: could not compile `rustc-demangle` (lib)
Caused by:
process didn't exit successfully: `/root/.rustup/toolchains/1.73.0-x86_64-unknown-linux-gnu/bin/rustc --crate-name rustc_demangle /root/.cargo/registry/src/index.crates.io-6f17d22bba15001f/rustc-demangle-0.1.23/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --diagnostic-width=171 --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debug-assertions=off -C metadata=156950085b5541ae -C extra-filename=-156950085b5541ae --out-dir /mnt/home/search/serving/text-embeddings-inference/target/release/deps -L dependency=/mnt/home/search/serving/text-embeddings-inference/target/release/deps --cap-lints allow -C target-cpu=native` (signal: 7, SIGBUS: access to undefined memory)
error: failed to compile `text-embeddings-router v0.6.0 (/mnt/home/search/serving/text-embeddings-inference/router)`, intermediate artifacts can be found at `/mnt/home/search/serving/text-embeddings-inference/target`.
To reuse those artifacts with a future compilation, set the environment variable `CARGO_TARGET_DIR` to that path.
+1
Anything specific on the machines you are running regarding AVX/SIMD ?
What are the CPUs ? https://github.com/BurntSushi/memchr/issues/57 Might be showing some insights.