quickwit
quickwit copied to clipboard
[Feature] Add SQL with Arrow Flight SQL
Is your feature request related to a problem? Please describe. Fast sql unified data access.
Describe the solution you'd like Arrow Flight SQL which gives possiblilities to retrieve data faster and also make a one unified standard driver to access.
Describe alternatives you've considered Actually there is no such.
Additional context There is new modern SQL way to retrieve data in a faster way through Arrow Flight SQL driver. There will be no need (it seams to be no) to have python or other kind of clients to access.
https://arrow.apache.org/docs/java/flight_sql_jdbc_driver.html# https://arrow.apache.org/blog/2022/02/16/introducing-arrow-flight-sql/ https://www.postgresql.org/about/news/apache-arrow-flight-sql-adapter-for-postgresql-010-2716/
Some explanations and research: https://www.vldb.org/pvldb/vol10/p1022-muehleisen.pdf
Some server examples: https://github.com/voltrondata/flight-sql-server-example https://www.kamu.dev/blog/2023-09-datafusion-flightsql/ https://github.com/kamu-data/kamu-cli