chroma icon indicating copy to clipboard operation
chroma copied to clipboard

[ENH] Add flags to the go binary for concurrency and stream processing.

Open rescrv opened this issue 9 months ago • 1 comments

By default, most grpc implementations allow up to 100 concurrent streams. We have 200 concurrent requests, basically guaranteeing queueing. Expose the two gRPC options in Go that will allow us to tune.

rescrv avatar Jan 09 '25 01:01 rescrv