chroma icon indicating copy to clipboard operation
chroma copied to clipboard

Insert into chroma with multi-processing (Is Chromadb process safe?)

Open jerry3027 opened this issue 2 years ago • 0 comments

I am trying to use python concurrent.futures to achieve multi-processing insert to Chroma DB. Right now, each of the sub-process spawns its own db connection chroma_client = chromadb.Client(Settings(chroma_db_impl="duckdb+parquet", persist_directory=persist_directory)). My question is: Is Chroma process safe for multi-processing insert where each sub-process has their own db connection?

It would be helpful if someone can answer this question for both the in memory case and client-server case.

jerry3027 avatar Apr 25 '23 02:04 jerry3027