iceberg
iceberg copied to clipboard
apache
Apache Iceberg
Bumps gradle-processors from 3.3.0 to 3.6.0. [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a...
![dependabot[bot] avatar](https://avatars.githubusercontent.com/in/29110?v=4 "dependabot[bot] avatar"){kind=avatar}
This change adds support for scanning from refs, where the scan can either be a time travel from a tag or a time travel from the tip of a branch.
This exposes position deletes as a metadata table "position_deletes", with schema: file, pos, row, partition This will be useful when trying to implement "RewritePositionDeleteFiles", as we will read positional deletes...
This PR is blocked on #4428 ## What is the purpose of the change Scan data using a specified tag or branch. ## Brief change log Add the following syntax...
Mentioned in https://github.com/apache/iceberg/issues/3582 as well. In the current spark procedures for snapshot expiration and removing orphan files, we delete s3 objects using the DeleteObject API which accepts 1 object. We...
Stem from this comment: https://github.com/apache/iceberg/pull/2521#issuecomment-828793923 We had a NPE bug (#2405) caused by reading a newly introduced field as `boolean`, which assigns null to this `boolean` field when reading old...
[Core][Spark] Improve DeleteOrphanFiles action to return additional details of deleted orphan files
## What changes are proposed in this PR? This PR adds a new Interface `OrphanFileStatus` that indicates if an orphan file was deleted or not. In cases of failure during...
### Feature Request / Improvement Re-assign the IDs when creating a new table. For more information, please refer to the comment: https://github.com/apache/iceberg/pull/5447#discussion_r940543443 How we do this in Java: https://github.com/apache/iceberg/blob/master/core/src/main/java/org/apache/iceberg/TableMetadata.java#L88-L133 ###...
### Apache Iceberg version 0.14.0 (latest release) ### Query engine Spark ### Please describe the bug 🐞 I'm migrating my solution from Spark 3.2.1 and Iceberg 0.13.2 to Spark 3.3.0...
And make the metadata-location mandatory. I haven't encountered anywhere where this was missing 🤔 Tests will be green after merging https://github.com/apache/iceberg/pull/5447