delta

delta copied to clipboard

delta-spark installation issues

1

I am installing Apache SPARK for the first time. I was able to install the docker container. I ran the following command: docker pull apache/spark and then started the container...

pkirangi

## Bug #### Which Delta project/connector is this regarding? - [x] Spark - [ ] Standalone - [ ] Flink - [ ] Kernel - [ ] Other (fill in...

tonkolviktor

Hello, We are using versioned s3 buckets that keep non-current versions for 60 days. Our delta tables use the default `delta.logRetentionDuration` setting of 30 days. We are wondering if there...

keenanwells-tatari

[BUG][SPARK] Errors with icebergShaded while setting up Delta on local machine

4

## Bug #### Which Delta project/connector is this regarding? - [ x] Spark - [ ] Standalone - [ ] Flink - [ ] Kernel - [ ] Other (fill...

Kishan-Kulkarni

## Description The following type changes available in the preview of type widening aren't supported by Iceberg and it will be very hard to support them - mainly due to...

johanl-db

## Description The following type changes available in the preview of type widening aren't supported by Iceberg and it will be very hard to support them - mainly due to...

johanl-db

## Description The following type changes available in the preview of type widening aren't supported by Iceberg and it will be very hard to support them - mainly due to...

johanl-db

[BUG][Spark] Changing type of map/array field referenced by a generated column or CHECK constraint not failing correctly

1

## Bug ### Describe the problem See https://github.com/delta-io/delta/pull/3601#discussion_r1740457343 Changing the data type of a field that is referenced by a generated column or CHECK constraint is forbidden as this may...

johanl-db

[Feature Request][Spark] Update UniForm related comment to include description to Hudi

2

## Feature request #### Which Delta project/connector is this regarding? - [x] Spark - [ ] Standalone - [ ] Flink - [ ] Kernel - [ ] Other (fill...

harperjiang

[BUG] - Inconsistent behavior between opensource delta and databricks runtime

4

## Bug ### Describe the problem Create a delta table with table properties like this got exception TBLPROPERTIES | ( delta.autoOptimize.autoCompact = true, | delta.autoOptimize.optimizeWrite = true, | delta.dataSkippingNumIndexedCols =...

bugsbunny1101