chroma
chroma copied to clipboard
[ENH] Add flags to the go binary for concurrency and stream processing.
By default, most grpc implementations allow up to 100 concurrent streams. We have 200 concurrent requests, basically guaranteeing queueing. Expose the two gRPC options in Go that will allow us to tune.