pymilvus icon indicating copy to clipboard operation
pymilvus copied to clipboard

[QUESTION]: how to set clientMaxSendSize/clientMaxRecvSize

Open haf-tech opened this issue 11 months ago • 3 comments

Is there an existing issue for this?

  • [X] I have searched the existing issues

What is your question?

How to set one of the following parameters clientMaxRecvSize or clientMaxSendSize, while using MilvusClient (from MilvusVectorStore, the LlamaIndex integration)

Intention is to solve the current issue:

run_pipeline: unexptected error occurred: err=<AioRpcError of RPC that terminated with:
        status = StatusCode.RESOURCE_EXHAUSTED
        details = "Received message larger than max (335498010 vs. 268435456)"
        debug_error_string = "UNKNOWN:Error received from peer unix:/var/folders/xn/4gqtx0wx3lb2yfvlkt9r8xz80000gn/T/tmp4h95t8sy_docling.db.sock {created_time:"2025-01-05T20:16:59.296208+01:00", grpc_status:8, grpc_message:"Received message larger than max (335498010 vs. 268435456)"}"

thinking to set (proxy.grpc.)clientMaxSendSize or (proxy.grpc.)clientMaxRecvSize, but not clear how and where - because the milvus.yaml configuration file is not used in such scenarios.

thanks for any hint.

Anything else?

No response

haf-tech avatar Jan 05 '25 19:01 haf-tech

@haf-tech PyMilvus already set the receive/send msgSize to infinitive https://github.com/milvus-io/pymilvus/blob/c70d44c45e7f96761d1d3808c7d7401eb65d5afe/pymilvus/client/async_grpc_handler.py#L143

Please refer to Milvus repository about how to set milvus.yaml: image

Doc: https://milvus.io/docs/configure_proxy.md#proxygrpcserverMaxSendSize

XuanYang-cn avatar Jan 06 '25 07:01 XuanYang-cn

@XuanYang-cn yes correctly, I would like to change the value, to a higher one. How is it possible to change this one, in the case that changing this milvus.yaml is not an option

haf-tech avatar Jan 06 '25 07:01 haf-tech

@haf-tech I believe this is what you're looking for:

  • use helm https://milvus.io/docs/configure-helm.md?tab=component
  • use docker-compose https://milvus.io/docs/configure-docker.md?tab=component

XuanYang-cn avatar Jan 07 '25 02:01 XuanYang-cn