kvcache-ai
[Bug]: Error in IPv6 support for mooncake 0.3.6 on vLLM 0.11.0
Bug Report
Currently, we are verifying IPv6 support for mooncake 0.3.6 on vLLM 0.11.0 and encountered the following error.
I20251110 13:07:19.029684 281472868256032 client_metric.cpp:76] Client metrics enabled (default enabled) I20251110 13:07:19.030521 281472868256032 transfer_engine.cpp:486] Metrics reporting is disabled (set MC_TE_METRIC=1 to enable) I20251110 13:07:19.031099 281472868256032 client.cpp:46] client_id=5927240954958100803-17443150218877136314 I20251110 13:07:19.031119 281472868256032 client.cpp:54] Client metrics enabled but reporting disabled (interval=0) I**20251110 13:07:19.031135 281472868256032 master_client.cpp:214] Connecting to master at [2001:db8::102]:50051 ^[[93m2025-11-10 13:07:19.034987 WARNING ^[[0m^[[0K[182881] [coro_rpc_client.hpp:579] client_id 1 async_resolve failed:Service not found ^[[93m2025-11-10 13:07:20.034996 WARNING ^[[0m^[[0K[182881] [coro_rpc_client.hpp:579] client_id 1 async_resolve failed:Service not found ^[[93m2025-11-10 13:07:21.061925 WARNING ^[[0m^[[0K[182881] [coro_rpc_client.hpp:579] client_id 1 async_resolve failed:Service not found ^[[93m2025-11-10 13:07:22.212742 WARNING ^[[0m^[[0K[182881] [coro_rpc_client.hpp:579] client_id 1 async_resolve failed:Service not found** ^[[93m2025-11-10 13:07:23.301799 WARNING ^[[0m^[[0K[182881] [client_pool.hpp:207] reconnect client{0x70984550},host:{[2001:db8::102]:50051} out of max limit, stop retry. connect failed ^[[93m2025-11-10 13:07:23.302183 WARNING ^[[0m^[[0K[182881] [client_pool.hpp:445] send request to [2001:db8::102]:50051 failed. connection refused. E20251110 13:07:23.302249 281458535035168 master_client.cpp:138] Client not available E20251110 13:07:23.302337 281472868256032 client.cpp:318] Failed to get fsdir from master I20251110 13:07:23.302380 281472868256032 client.cpp:106] auto discovery not set by env MC_MS_AUTO_DISC W20251110 13:07:23.302390 281472868256032 common.h:143] Illegal port number in [2001:db8::102]. Use default port 12001 instead W20251110 13:07:23.302402 281472868256032 common.h:143] Illegal port number in [2001:db8::102]. Use default port 12001 instead I20251110 13:07:23.302408 281472868256032 transfer_engine.cpp:91] Transfer Engine parseHostNameWithPort. server_name: 2001:db8::102 port: 12001 ^[[93m2025-11-10 13:07:23.304886 WARNING ^[[0m^[[0K[182883] [coro_rpc_client.hpp:579] client_id 1 async_resolve failed:Service not found
We tried modifying the following file where host is lost
Mooncake/mooncak-strore/src/http_metadata_server.cpp
HttpMetadataServer::HttpMetadataServer(uint16_t port, const std::string& host) : port_(port), host_(host), server_(std::make_unique<coro_http::coro_http_server>(4, port, host_)), ##here host is lost running_(false) { init_server(); }
but we found that when using ipv6 address like :: or ::1 ,that works;but when use ipv6 address like fe80:::1,that even can't be listened using netstat -lnp | grep 8081
Could you please help check whether version 0.3.6 supports IPv6, and whether the third-party libraries ylt coro_rpc/coro_http have been verified for IPv6?
Before submitting...
- [ ] Ensure you searched for relevant issues and read the [documentation]
Mooncake currently doesn’t support IPv6. Are you running on a pure IPv6 network without any IPv4 available?
Actually, Mooncake doesn't fully support IPv6. Some components such as Transport can support IPv6, but not for http metadata server and coro rpc.
Mooncake currently doesn’t support IPv6. Are you running on a pure IPv6 network without any IPv4 available?
is there a plan?
Actually, Mooncake doesn't fully support IPv6. Some components such as Transport can support IPv6, but not for http metadata server and coro rpc.
thx for your reply! is there a plan to support IPv6?
Mooncake currently doesn’t support IPv6. Are you running on a pure IPv6 network without any IPv4 available?
I’m afraid so. T . T