cloudbeaver icon indicating copy to clipboard operation
cloudbeaver copied to clipboard

Support Apache Kyuubi as built-in datasource

Open pan3793 opened this issue 2 years ago • 1 comments

Apache Kyuubi(Incubating) was added into DBeaver in https://github.com/dbeaver/dbeaver/pull/16559, and now I propose to add Kyuubi as a built-in data source of CloudBeaver.

Kyuubi already use CloudBeaver to build a public online playground https://try.kyuubi.cloud/, it runs well for several months.

Kyuubi JDBC driver is derived from Hive JDBC driver, but we reworked a lot to make it light and powerful.

I saw there was an issue https://github.com/dbeaver/cloudbeaver/issues/312 about adding Hive JDBC driver as built-in, but the maintainers concerns the size and dependencies of Hive JDBC jar.

Kyuubi JDBC resolved those issues,

  • The size of kyuubi-hive-jdbc-shaded-1.6.1-incubating.jar is 10.8MB.
  • The jar is a all-in-one artifacts, all thrid party classes have been relocated to org.apache.kyuubi package, so there is no class conflict issues.
  • It's compatible w/ Kyuubi, Spark Thrift Server, and Hive Server2, including Zookeeper-based HA, Kerberos features.

For maintainers testing, Kyuubi provides a docker compose based playground[1] to quick launch a Kyuubi deployment w/ TPC-DS dataset, and documentation[2] how to use DBeaver to connect to Kyuubi.

[1] https://github.com/apache/incubator-kyuubi/tree/master/docker/playground [2] https://kyuubi.readthedocs.io/en/latest/client/bi_tools/dbeaver.html

pan3793 avatar Dec 04 '22 09:12 pan3793

I don't have the permission to access the Jenkins, could any member help me to check why it fails?

pan3793 avatar Dec 05 '22 12:12 pan3793

@serge-rider I sincerely hope the CloudBeaver community can consider this integration.

I have been asked several times by users from the Apache Kyuubi community about how to use CloudBeaver to access Kyuubi service, and as a temporary solution, I created a forked repo to provide that, would appreciate it if it can be adopted upstream :)

pan3793 avatar Feb 23 '24 09:02 pan3793

+1 for this

cfmcgrady avatar Feb 23 '24 09:02 cfmcgrady

+1 for this

cxzl25 avatar Feb 23 '24 09:02 cxzl25

+1. Kyuubi support makes sense to me.

SteNicholas avatar Feb 23 '24 09:02 SteNicholas

+1

bowenliang123 avatar Feb 23 '24 10:02 bowenliang123

Agreed 👍

serge-rider avatar Feb 23 '24 10:02 serge-rider

@pan3793 The most recent version of the driver has 4 open CVEs. Unfortunately, in its current form we cannot include it in the product. For now, you can add it yourself.

EvgeniaBzzz avatar Feb 23 '24 13:02 EvgeniaBzzz

@EvgeniaBzzz

The most recent version of the driver has 4 open CVEs.

Where can I find the list?

I'm one of the maintainers of org.apache.kyuubi/kyuubi-hive-jdbc-shaded, and we haven't received CVE reports yet.

If you have security-related concerns about publicly discussing the details of an unfixed CVE, please send messages to mailto:[email protected]

pan3793 avatar Feb 23 '24 13:02 pan3793

@pan3793 You can find it on Maven repository

EvgeniaBzzz avatar Feb 23 '24 19:02 EvgeniaBzzz

Thanks for the update @pan3793

LonwoLonwo avatar Mar 19 '24 16:03 LonwoLonwo

@EvgeniaBzzz @LonwoLonwo The Apache Kyuubi 1.9.0 just release now, we have addressed all known CVEs, the latest JDBC Driver available in Maven Central has no CVE warnings too.

pan3793 avatar Mar 19 '24 17:03 pan3793

Kindly ping @EvgeniaBzzz @alexander-skoblikov ~

pan3793 avatar Mar 25 '24 16:03 pan3793

Hi @pan3793! We plan to integrate it during two weeks

EvgeniaBzzz avatar Mar 25 '24 19:03 EvgeniaBzzz

@EvgeniaBzzz thank you for the information!

pan3793 avatar Mar 26 '24 02:03 pan3793

thank you, @yagudin10

pan3793 avatar Mar 26 '24 09:03 pan3793

@alexander-skoblikov thank you, and everyone!

pan3793 avatar Mar 29 '24 02:03 pan3793

Thank you for your contribution and your patience!

LonwoLonwo avatar Mar 29 '24 18:03 LonwoLonwo