Mooncake icon indicating copy to clipboard operation
Mooncake copied to clipboard

[Usage]: How to compile/run nixl bench using mooncake TE as backend

Open alokprasad opened this issue 2 months ago • 4 comments

Describe your usage question

Is there a detailed step of running nixlbnech over two nodes (rdma) with mooncake TE as backend.

Before submitting a new issue...

  • [ ] Make sure you already searched for relevant issues and read the documentation

alokprasad avatar Oct 17 '25 09:10 alokprasad

We are preparing a detailed step-by-step guide of NIXL Bench. Here is a brief version:

  1. Build & Install Mooncake:
git clone https://github.com/kvcache-ai/Mooncake
sudo bash ./dependencies.sh
mkdir build && cd build
cmake .. -DBUILD_SHARED_LIBS=ON
sudo make && make install
ldconfig
  1. Build NIXL using meson in its root directory, then install
  2. Build and install libetcd-cpp-apiv3
  3. Build NIXLBench using meson in its directory. Make sure the libraries be searchable with LD_LIBRARY_PATH.

alogfans avatar Oct 17 '25 12:10 alogfans

@alogfans mooncake, libetcd builds fine ,but facing issue with NIXL https://github.com/ai-dynamo/nixl/issues/940

alokprasad avatar Oct 22 '25 10:10 alokprasad

Maybe we should support building mooncake-based nixl without etcd? @alogfans

stmatengss avatar Oct 23 '25 09:10 stmatengss

@alogfans @stmatengss anything i can try to bypass this error.

alokprasad avatar Oct 28 '25 07:10 alokprasad