pymilvus
pymilvus copied to clipboard
[QUESTION]: how to set clientMaxSendSize/clientMaxRecvSize
Is there an existing issue for this?
- [X] I have searched the existing issues
What is your question?
How to set one of the following parameters clientMaxRecvSize or clientMaxSendSize, while using MilvusClient (from MilvusVectorStore, the LlamaIndex integration)
Intention is to solve the current issue:
run_pipeline: unexptected error occurred: err=<AioRpcError of RPC that terminated with:
status = StatusCode.RESOURCE_EXHAUSTED
details = "Received message larger than max (335498010 vs. 268435456)"
debug_error_string = "UNKNOWN:Error received from peer unix:/var/folders/xn/4gqtx0wx3lb2yfvlkt9r8xz80000gn/T/tmp4h95t8sy_docling.db.sock {created_time:"2025-01-05T20:16:59.296208+01:00", grpc_status:8, grpc_message:"Received message larger than max (335498010 vs. 268435456)"}"
thinking to set (proxy.grpc.)clientMaxSendSize or (proxy.grpc.)clientMaxRecvSize, but not clear how and where - because the milvus.yaml configuration file is not used in such scenarios.
thanks for any hint.
Anything else?
No response
@haf-tech PyMilvus already set the receive/send msgSize to infinitive https://github.com/milvus-io/pymilvus/blob/c70d44c45e7f96761d1d3808c7d7401eb65d5afe/pymilvus/client/async_grpc_handler.py#L143
Please refer to Milvus repository about how to set milvus.yaml:
Doc: https://milvus.io/docs/configure_proxy.md#proxygrpcserverMaxSendSize
@XuanYang-cn yes correctly, I would like to change the value, to a higher one. How is it possible to change this one, in the case that changing this milvus.yaml is not an option
@haf-tech I believe this is what you're looking for:
- use helm https://milvus.io/docs/configure-helm.md?tab=component
- use docker-compose https://milvus.io/docs/configure-docker.md?tab=component