duck-read-cache-fs icon indicating copy to clipboard operation
duck-read-cache-fs copied to clipboard

Feature request: add stats for IO operation status and retry

Open dentiny opened this issue 7 months ago • 0 comments

Is your feature request related to a problem? Please describe. I'm debugging a production issue, more or less related to duckdb httpfs; I cannot explain the high GET request count with very little actual data transferred.

Describe the solution you'd like One way to improve observability, is to

  • Record IO operation status, tagged by http request type (for our extension it might be FileSystem operation) and its status
  • Perform retry within the extension, rather than rely on duckdb's, otherwise it's hard to tell a slow request against a retried bad request.

Describe alternatives you've considered N/A

Additional context N/A

dentiny avatar May 01 '25 00:05 dentiny