yihao.dai
yihao.dai
**Test 2** Setting msgstream receive buffer size from **1024** to **10**, then using pprof to analyze. Result: - About 90% memory consumed by insertBuffer;  InsertBuffer consumed about **2GB**, however,...
**Test 3** I assume that the arrow payload writer in C++ consumed a lot of memroy, so I added a log to print the arrow memory pool size. Result: -...
**Test 4** I'm attempting to replicate this issue on my local machine and I have observed that DataNode's memory usage increases gradully over time. I used heaptrack to analyze. Result:...
https://github.com/milvus-io/milvus/pull/23138 upgraded arrow, may resolve this issue, please help to make a verify @elstic
/assign @elstic
https://github.com/milvus-io/milvus/pull/24656 with go payload wirter, datanode oom issue may be resolved.
/assign @elstic please help to make a verify @elstic
@ThreadDao Should be resolved. Please help to retry with this image: `harbor.milvus.io/milvus/milvus:bigsheeper-2304-memory-sync-53814d8-20230410` https://jenkins.milvus.io:18080/blue/organizations/jenkins/milvus-images%2Fbuild-dev-image/detail/build-dev-image/519/pipeline/
> we need to think about this. > why the task queue need to rely on some meta? This test is based on a test branch and hasn’t picked up...