emkornfield

Results 20 issues of


                                            emkornfield

Support for dependent blocks on decompressing LZ4 Frame Data?

Are there any plans to add this feature? Are there any caveats for a PR providing this feature?

PARQUET-2495: Update merge script to python3

- Fixes differences between python2 and python3 - Unifies to only using git as gitbox is no longer necessary. - Used to merge PARQUET-2483 - Adds options to clear existing...

PARQUET-2489: Guidance on feature releases

Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Parquet Jira](https://issues.apache.org/jira/browse/PARQUET/) issues and references them in the PR title. For example,...

DRAFT: Alternative Strawman proposal for a new V3 footer format in Parquet

As a point of discussion a slightly different version of showing how column metadata could be decoupled from FileMetadata then https://github.com/apache/parquet-format/pull/242 In particular this takes a slightly different approach: 1....

Initial committer guidelines and requirements for merging

Based on mailing list discussion add focused language to contributing.md on committing PRs.

docs

[Kernel][Type Widening] 9/ Implement TypeChange Parsing

## 🥞 Stacked PR Use this [link](https://github.com/delta-io/delta/pull/4593/files/d0071707d48f8f24b5be8c172bbb54f0479fb4ca..a1082b7fc1282cccae6ef208497df90385b01cb5) to review incremental changes. - [stack/tw_type_changes](https://github.com/delta-io/delta/pull/4568) [[Files changed](https://github.com/delta-io/delta/pull/4568/files)] - [stack/tw_type_changes_to_field_metadata](https://github.com/delta-io/delta/pull/4588) [[Files changed](https://github.com/delta-io/delta/pull/4588/files/ec53e86640798f8ee10990186494a3354c26ebf5..41038d9747663715f3a1d050a1decb6b87199f58)] - [stack/tw_type_changes_to_field_metadata_impl](https://github.com/delta-io/delta/pull/4589) [[Files changed](https://github.com/delta-io/delta/pull/4589/files/41038d9747663715f3a1d050a1decb6b87199f58..5a3d12da1a595180925c720ef815ac5848096ad8)] - [stack/tw_serde_refactor](https://github.com/delta-io/delta/pull/4592) [[Files changed](https://github.com/delta-io/delta/pull/4592/files/5a3d12da1a595180925c720ef815ac5848096ad8..d0071707d48f8f24b5be8c172bbb54f0479fb4ca)] - [**stack/add_type_change_parsing**](https://github.com/delta-io/delta/pull/4593) [[Files...

[Kernel][Type Widening] 8/ refactor collation parsing/setting not be intertwined with type parsing

## 🥞 Stacked PR Use this [link](https://github.com/delta-io/delta/pull/4592/files/5a3d12da1a595180925c720ef815ac5848096ad8..d0071707d48f8f24b5be8c172bbb54f0479fb4ca) to review incremental changes. - [stack/tw_type_changes](https://github.com/delta-io/delta/pull/4568) [[Files changed](https://github.com/delta-io/delta/pull/4568/files)] - [stack/tw_type_changes_to_field_metadata](https://github.com/delta-io/delta/pull/4588) [[Files changed](https://github.com/delta-io/delta/pull/4588/files/ec53e86640798f8ee10990186494a3354c26ebf5..41038d9747663715f3a1d050a1decb6b87199f58)] - [stack/tw_type_changes_to_field_metadata_impl](https://github.com/delta-io/delta/pull/4589) [[Files changed](https://github.com/delta-io/delta/pull/4589/files/41038d9747663715f3a1d050a1decb6b87199f58..5a3d12da1a595180925c720ef815ac5848096ad8)] - [**stack/tw_serde_refactor**](https://github.com/delta-io/delta/pull/4592) [[Files changed](https://github.com/delta-io/delta/pull/4592/files/5a3d12da1a595180925c720ef815ac5848096ad8..d0071707d48f8f24b5be8c172bbb54f0479fb4ca)] - [stack/add_type_change_parsing](https://github.com/delta-io/delta/pull/4593) [[Files...

[Kernel][Type Widening] 9/ Add iceberg compat check for type changes

## 🥞 Stacked PR Use this [link](https://github.com/delta-io/delta/pull/4603/files/a1082b7fc1282cccae6ef208497df90385b01cb5..107088b72199223b8eaf710cd7a39303b4463a21) to review incremental changes. - [stack/tw_type_changes](https://github.com/delta-io/delta/pull/4568) [[Files changed](https://github.com/delta-io/delta/pull/4568/files)] - [stack/tw_type_changes_to_field_metadata](https://github.com/delta-io/delta/pull/4588) [[Files changed](https://github.com/delta-io/delta/pull/4588/files/ec53e86640798f8ee10990186494a3354c26ebf5..41038d9747663715f3a1d050a1decb6b87199f58)] - [stack/tw_type_changes_to_field_metadata_impl](https://github.com/delta-io/delta/pull/4589) [[Files changed](https://github.com/delta-io/delta/pull/4589/files/41038d9747663715f3a1d050a1decb6b87199f58..5a3d12da1a595180925c720ef815ac5848096ad8)] - [stack/tw_serde_refactor](https://github.com/delta-io/delta/pull/4592) [[Files changed](https://github.com/delta-io/delta/pull/4592/files/5a3d12da1a595180925c720ef815ac5848096ad8..d0071707d48f8f24b5be8c172bbb54f0479fb4ca)] - [stack/add_type_change_parsing](https://github.com/delta-io/delta/pull/4593) [[Files...

[Kernel][Type Widening] 7/ Collect TypeChanges to FieldMetadata

## 🥞 Stacked PR Use this [link](https://github.com/delta-io/delta/pull/4589/files/41038d9747663715f3a1d050a1decb6b87199f58..5a3d12da1a595180925c720ef815ac5848096ad8) to review incremental changes. - [stack/tw_type_changes](https://github.com/delta-io/delta/pull/4568) [[Files changed](https://github.com/delta-io/delta/pull/4568/files)] - [stack/tw_type_changes_to_field_metadata](https://github.com/delta-io/delta/pull/4588) [[Files changed](https://github.com/delta-io/delta/pull/4588/files/ec53e86640798f8ee10990186494a3354c26ebf5..41038d9747663715f3a1d050a1decb6b87199f58)] - [**stack/tw_type_changes_to_field_metadata_impl**](https://github.com/delta-io/delta/pull/4589) [[Files changed](https://github.com/delta-io/delta/pull/4589/files/41038d9747663715f3a1d050a1decb6b87199f58..5a3d12da1a595180925c720ef815ac5848096ad8)] - [stack/tw_serde_refactor](https://github.com/delta-io/delta/pull/4592) [[Files changed](https://github.com/delta-io/delta/pull/4592/files/5a3d12da1a595180925c720ef815ac5848096ad8..d0071707d48f8f24b5be8c172bbb54f0479fb4ca)] - [stack/add_type_change_parsing](https://github.com/delta-io/delta/pull/4593) [[Files...

[Kernel][Type Widening] 6/ Add ability to skip recursion on SchemaIterable and refactor collation fetching

## 🥞 Stacked PR Use this [link](https://github.com/delta-io/delta/pull/4588/files/ec53e86640798f8ee10990186494a3354c26ebf5..41038d9747663715f3a1d050a1decb6b87199f58) to review incremental changes. - [stack/tw_type_changes](https://github.com/delta-io/delta/pull/4568) [[Files changed](https://github.com/delta-io/delta/pull/4568/files)] - [**stack/tw_type_changes_to_field_metadata**](https://github.com/delta-io/delta/pull/4588) [[Files changed](https://github.com/delta-io/delta/pull/4588/files/ec53e86640798f8ee10990186494a3354c26ebf5..41038d9747663715f3a1d050a1decb6b87199f58)] - [stack/tw_type_changes_to_field_metadata_impl](https://github.com/delta-io/delta/pull/4589) [[Files changed](https://github.com/delta-io/delta/pull/4589/files/41038d9747663715f3a1d050a1decb6b87199f58..5a3d12da1a595180925c720ef815ac5848096ad8)] - [stack/tw_serde_refactor](https://github.com/delta-io/delta/pull/4592) [[Files changed](https://github.com/delta-io/delta/pull/4592/files/5a3d12da1a595180925c720ef815ac5848096ad8..d0071707d48f8f24b5be8c172bbb54f0479fb4ca)] - [stack/add_type_change_parsing](https://github.com/delta-io/delta/pull/4593) [[Files...