delta

delta copied to clipboard

## Description Resolves https://github.com/delta-io/delta/issues/1304 ## How was this patch tested? Added tests to DeltaSinkSuite, DeltaSuite and OptimisticTransactionSuite ## Does this PR introduce _any_ user-facing changes? Yes, user can now set...

koertkuipers

## Feature request ### Overview i had 2 concurrent jobs on same table: one is batch that runs on a certain schedule and reads the table and updates it. the...

koertkuipers

Enable WriteSerializable Isolation Level

7

## Description Resolves #1261 ## How was this patch tested? Added tests for isolation level WriteSerializable in OptimisticTransactionSuite ## Does this PR introduce _any_ user-facing changes? Yes. it enabled setting...

koertkuipers

Move SupportsAdmissionControl methods to DeltaSourceBase

1

`DeltaSourceBase` is a `SupportsAdmissionControl` but all the methods are in `DeltaSource` (looks like a leftover after a code refactor?) They should be moved off of `DeltaSource` to `DeltaSourceBase`. /cc @scottsand-db

jaceklaskowski

[BUG] Delta table on S3 doesn't delete historical log files (using GLUE and EMR)

12

## Bug Delta table property `'delta.logRetentionDuration'='interval 7 days'` doesn't take effect using AWS glue catalog (external table) and EMR. ### Describe the problem We are using Databricks Delta lake open...

maor-sa

Update PROTOCOL to include change data spec

1

## Description Update PROTOCOL.md to include change data file spec. I think it's possible to consider these new change files as "data files", but I've documented them as their own...

nkarpov

Add isolationLevel delta config but only allow Serializable for now

1

## Description Resolves #1265 ## How was this patch tested? Added test to DeltaConfigSuite for setting isolation level ## Does this PR introduce _any_ user-facing changes? Yes, user can now...

koertkuipers

[BUG] ActionSerializerSuite has 3 failing unit tests in the master branch

5

## Bug ### Describe the problem Following unit tests fail: - Metadata (with all defaults) - Metadata - json serialization/deserialization - Metadata with empty createdTime- json serialization/deserialization - #### Steps...

ganeshchand

Signed-off-by: Thomas Newton ## Description Run doctoc to auto-update the table of contents. This PR was repurposed after what it was originally intended to document was discovered to be a...

Tom-Newton

Add terraform deploying infrastructure for benchmarks

2

## Description Currently, in order to run performance benchmarks one need to create the infrastructure manually. This PR adds Terraform scripts which do that automatically for AWS and GCP. ##...

grzegorz8