Johan Lasperas
Johan Lasperas
#### Which Delta project/connector is this regarding? - [X] Spark - [ ] Standalone - [ ] Flink - [ ] Kernel - [ ] Other (fill in here) ##...
This is a cherry-pick of https://github.com/delta-io/delta/pull/2156 to delta-2.4 branch. #### Which Delta project/connector is this regarding? - [x] Spark - [ ] Standalone - [ ] Flink - [ ]...
This is a cherry-pick of https://github.com/delta-io/delta/pull/2128 to delta-2.3 branch. #### Which Delta project/connector is this regarding? - [x] Spark - [ ] Standalone - [ ] Flink - [ ]...
## Bug ### Describe the problem Inserting data into an existing table behaves differently when using SQL vs python/scala and when using `saveAsTable` vs. `insertInto`. If the ingested data uses...
Prototype implementation for the type widening table feature in Delta Kernel. ## Description This prototype allows reading tables that had a type change applied using the type widening table feature,...
Cherry-pick of https://github.com/delta-io/delta/pull/3036 to `master` ## Description Add a documentation page for the type widening table feature, in preview in Delta. 3.2 ## How was this patch tested? N/A
## Description Add a documentation page for the type widening table feature, in preview in Delta. 3.2 ## How was this patch tested? N/A
## Description Spark started using ANSI mode enabled by default, breaking a couple of tests in `GeneratedColumnSuite` that contained slient overflows. These tests are updated to remove the overflows. ##...
This PR adds shims to ungate the remaining type changes that only work with Spark 4.0 / master. Spark 4.0 contains the required changes to Parquet readers to be able...
## Description Additional tests covering type widening and: - Reading CDF - Column mapping - Time travel - RESTORE - CLONE ## How was this patch tested? Test only