influxdb-client-csharp icon indicating copy to clipboard operation
influxdb-client-csharp copied to clipboard

Support for Very Large Queries --> Currently Error is Thrown on Large Queries Even When Using Query With Stream

Open pzatschl opened this issue 1 year ago • 1 comments

Proposal: Adding support for querying very large data sets or adding a disclaimer about the capabilities of the stream Query function (like for the non-stream version).

Current behavior: Currently, when trying to query a large data set

System.Net.Http.HttpRequestException: Cannot write more bytes to the buffer than the configured maximum buffer size: 2147483647.
   at InfluxDB.Client.Core.Internal.AbstractQueryClient.Query(Func`2 queryFn, Action`1 consumer, Action`1 onError, Action onComplete, CancellationToken cancellationToken)

is thrown.

Desired behavior: The application should not throw the error./Should make clear what size of query is allowed.

Alternatives considered: One could use smaller queries but this would be less convenient

Use case: We use this for transferring data from InfluxDB to a cloud application. (Reading the DB and uploading it)

pzatschl avatar Aug 14 '23 07:08 pzatschl