delta

delta copied to clipboard

[BUG] Fix DeltaTableBuilder metadata configuration

7

## Bug ### Describe the problem Currently, when `DeltaTableBuilder` is given a property that does not start with a `delta.` prefix, then that property is written to the table metadata...

scottsand-db

SHOW CREATE TABLE is unsupported

3

Hi delta team, I'm trying to run `SHOW CREATE TABLE` in my local development environment and the error occurs, but the statement works well in Databricks environment. I'm wondering whether...

yifeng-chen

[Feature Request] LogStore integration test framework

4

## Feature request ### Overview It would be great to have an automated integration test framework for all of our LogStores that includes a) integration-testing (using real cloud buckets/tables) and...

scottsand-db

[Feature Request] Reduce test runtime by parallelizing tests

1

## Feature request ### Overview SBT tests currently run sequentially. It would be good to reduce the total test runtime by parallelizing the SBT tests. ### Motivation SBT tests are...

tdas

[BUG] INSERT INTO with generated columns fails (not enough data columns)

4

When executing `sql("INSERT INTO delta_gencols VALUES 1")` Delta Lake 1.2.1 fails with the following `AnalysisException`: ```text org.apache.spark.sql.AnalysisException: Cannot write to 'default.delta_gencols', not enough data columns; target table has 2 column(s)...

jaceklaskowski

Support `TIMESTAMP AS OF`, `VERSION AS OF` in SQL

20

Please add support for the time travel functions `TIMESTAMP AS OF`, `VERSION AS OF`~, and `DESCRIBE HISTORY`~. Time travel is a critical Delta use. Cheers. -- Updated by @zsxwing :...

spmp

[Feature Request] Make DELETE operations return the number of deleted rows

4

## Feature request ### Overview Currently, the `DELETE` operation returns an empty result. It would be more useful if it returned the number of deleted rows. ### Motivation The number...

scottsand-db

The delta log is too large, and OOM always occurs when the delta log checkpoint is executed.[BUG]

1

## Bug At present, the latest data size of the delta log is as follows, checkpointSize: 7639547 numOfFiles: 5140110  At present, the given memory size of each executor is...

kongluo

Is it reasonable that some tasks have obvious data skew when executing compute snapshot?[BUG]

2

### Describe the problem When the delta log log becomes larger, it is found that during the process of executing the compute snapshot, the operation task execution has obvious data...

kongluo

## Feature request ### Overview If I write to a Delta table, the write operation updates the table's version. There is no way to determine what version was just created...

nchammas