quickwit icon indicating copy to clipboard operation
quickwit copied to clipboard

[Feature] Add SQL with Arrow Flight SQL

Open YuriyGavrilov opened this issue 9 months ago • 1 comments

Is your feature request related to a problem? Please describe. Fast sql unified data access.

Describe the solution you'd like Arrow Flight SQL which gives possiblilities to retrieve data faster and also make a one unified standard driver to access.

Describe alternatives you've considered Actually there is no such.

Additional context There is new modern SQL way to retrieve data in a faster way through Arrow Flight SQL driver. There will be no need (it seams to be no) to have python or other kind of clients to access.

https://arrow.apache.org/docs/java/flight_sql_jdbc_driver.html# https://arrow.apache.org/blog/2022/02/16/introducing-arrow-flight-sql/ https://www.postgresql.org/about/news/apache-arrow-flight-sql-adapter-for-postgresql-010-2716/

Some explanations and research: https://www.vldb.org/pvldb/vol10/p1022-muehleisen.pdf

Some server examples: https://github.com/voltrondata/flight-sql-server-example https://www.kamu.dev/blog/2023-09-datafusion-flightsql/ https://github.com/kamu-data/kamu-cli

YuriyGavrilov avatar Oct 30 '23 21:10 YuriyGavrilov