querybook icon indicating copy to clipboard operation
querybook copied to clipboard

Feature Request: Add Arrow Flight SQL Driver

Open YuriyGavrilov opened this issue 1 year ago • 5 comments

There is new modern SQL way to retrieve data in a faster way through Arrow Flight SQL driver.

https://arrow.apache.org/docs/java/flight_sql_jdbc_driver.html# https://arrow.apache.org/blog/2022/02/16/introducing-arrow-flight-sql/ https://www.postgresql.org/about/news/apache-arrow-flight-sql-adapter-for-postgresql-010-2716/

Some explanations and research: https://www.vldb.org/pvldb/vol10/p1022-muehleisen.pdf

Some server examples:

  • https://github.com/voltrondata/flight-sql-server-example
  • https://www.kamu.dev/blog/2023-09-datafusion-flightsql/ https://github.com/kamu-data/kamu-cli

YuriyGavrilov avatar Oct 30 '23 20:10 YuriyGavrilov

@YuriyGavrilov https://github.com/influxdata/flightsql-dbapi

web3creator avatar Nov 24 '23 19:11 web3creator

@web3creator yep thx!, there also Dremio support it, but not sure that with same driver as querybook has.

YuriyGavrilov avatar Nov 24 '23 19:11 YuriyGavrilov

@YuriyGavrilov I just developed a version and I tested that it can be supported, need to change some code adaptation. It can be supported. You need to do some development.

web3creator avatar Nov 24 '23 19:11 web3creator

@YuriyGavrilov Dremio hava bug,dremio cannot

web3creator avatar Nov 24 '23 19:11 web3creator

@web3creator Dremio has own jdbc arrow, https://www.dremio.com/drivers/jdbc/ maybe it could fix bug? ( also it support only dremio 21+ version)

YuriyGavrilov avatar Dec 04 '23 14:12 YuriyGavrilov