Huajun Li

libccl.so.1.0 size is so large

8

Following the readme, I built out libccl.so.1.0 from master branch, but the lib is so big about 300M. While in oneAPI BaseKit, this lib is ~9M. Any suggustion?

enable rpc for multi nodes

2

For llama cpp sycl backend, please help to enable rpc for multiple nodes. -DGGML_RPC=ON Please refer to : https://github.com/ggml-org/llama.cpp/tree/master/tools/rpc