qdrant-js icon indicating copy to clipboard operation
qdrant-js copied to clipboard

Memory Leaks during batch point inserts

Open PJanko opened this issue 1 year ago • 2 comments

Hello

I'm using the library using the REST client to batch insert points (by 1000) in a cloud QDrant cluster. After 185000 points inserted my script crashed, running out of heap. (the node process was using 4GB of memory at that time)

I can not deep dive into the issue, but I was able to perform my task using the REST API directly.

Regards

PJanko avatar Oct 25 '23 12:10 PJanko

increase memory limit using:

MacOS:

export NODE_OPTIONS="--max-old-space-size=8192"

-----------------------------------------------

Windows:

set NODE_OPTIONS="--max-old-space-size=8192"

can help you prevent memory leak, BTW you need batch update

hiepxanh avatar Feb 23 '24 02:02 hiepxanh

Could you please share a showcase with the specific example causing this?

Rendez avatar Mar 01 '24 15:03 Rendez