Mooncake
Mooncake copied to clipboard
[Usage]: How to compile/run nixl bench using mooncake TE as backend
Describe your usage question
Is there a detailed step of running nixlbnech over two nodes (rdma) with mooncake TE as backend.
Before submitting a new issue...
- [ ] Make sure you already searched for relevant issues and read the documentation
We are preparing a detailed step-by-step guide of NIXL Bench. Here is a brief version:
- Build & Install Mooncake:
git clone https://github.com/kvcache-ai/Mooncake
sudo bash ./dependencies.sh
mkdir build && cd build
cmake .. -DBUILD_SHARED_LIBS=ON
sudo make && make install
ldconfig
- Build NIXL using meson in its root directory, then install
- Build and install libetcd-cpp-apiv3
- Build NIXLBench using meson in its directory. Make sure the libraries be searchable with LD_LIBRARY_PATH.
@alogfans mooncake, libetcd builds fine ,but facing issue with NIXL https://github.com/ai-dynamo/nixl/issues/940
Maybe we should support building mooncake-based nixl without etcd? @alogfans
@alogfans @stmatengss anything i can try to bypass this error.