Are you Interested in integrating XSQL into Scriptis and Linkis?

[wushengyeyouya]

Hi, Your project is particularly great, but there are certain thresholds for analysis users. Are you Interested in integrating XSQL into Scriptis and Linkis? . Scriptis: https://github.com/WeBankFinTech/Scriptis Linkis: https://github.com/WeBankFinTech/Linkis I look forward to your reply. Thank you very much.

[WeiWenda]

@wushengyeyouya do you want to use hive thriftserver2 jdbc？

[wushengyeyouya]

Linkis support spark engine, and we can implement a new EngineHook to get the ability of XSQL. Scriptis can show the metadata of XSQL holded, and submit sql to linkis.

[WeiWenda]

How does Scriptis&Linkis use spark now? xsql usage is all the same as spark

[wushengyeyouya]

Linkis use spark repl to obtain the ability of spark. So we think Scriptis&Linkis is pretty easy to integrate XSQL.

[WeiWenda]

You can configure spark.sql.catalogImplementation=xsql in spark-defaults.conf，so that spark-shell、spark-sql、spark-submit will enable XSQL syntax. But above configuration only works in bin version, spark.sql.catalogImplementation=xsql is not allowed in raw spark.