kyuubi icon indicating copy to clipboard operation
kyuubi copied to clipboard

[Bug] Incomplete operation for create table with Delta Lake

Open yaooqinn opened this issue 2 years ago • 3 comments

Code of Conduct

Search before asking

  • [X] I have searched in the issues and found no similar issues.

Describe the bug

After successfully create a delta table with ddl below

CREATE TABLE IF NOT EXISTS kyuubi_delta (
  id INT,
  name STRING,
  org STRING,
  url STRING,
  start TIMESTAMP
) USING DELTA

Then run a simple query

select * from kyuubi_delta;

Error occurs

org.apache.spark.sql.AnalysisException: `file:/Users/kentyao/incubator-kyuubi/dist/work/kentyao/spark-warehouse/kyuubi_delta` is not a Delta table.

Seems that _delta_log shall be generated whereas the table location ...spark-warehouse/kyuubi_delta is empty.

Affects Version(s)

master

Kyuubi Server Log Output

No response

Kyuubi Engine Log Output

No response

Kyuubi Server Configurations

No response

Kyuubi Engine Configurations

spark.sql.extensions=io.delta.sql.DeltaSparkSessionExtension spark.sql.catalog.spark_catalog=org.apache.spark.sql.delta.catalog.DeltaCatalog

Additional context

No response

Are you willing to submit PR?

  • [ ] Yes I am willing to submit a PR!

yaooqinn avatar Jul 13 '22 07:07 yaooqinn

cc @cfmcgrady can you take a look?

yaooqinn avatar Jul 13 '22 07:07 yaooqinn

cc @cfmcgrady can you take a look?

thank you for ping me. I'm a little busy with the mid-year wrap-up right now, I will take a look when I'm free, maybe next week.

cfmcgrady avatar Jul 13 '22 09:07 cfmcgrady

good luck! @cfmcgrady

yaooqinn avatar Jul 13 '22 10:07 yaooqinn