iceberg
iceberg copied to clipboard
apache
Apache Iceberg
To split the PR https://github.com/apache/iceberg/pull/3450, open a new PR to add time (year, month, day, hour) transforms.
Port some PRs to Spark 3.1: * #3373 * #3456 * #3491 * #3287 * #3505 * #3721 * #3557 * #4198 * #4381 * #3535 * #4419
This is the first part of #4842. Add the schema id to DataFile/DeteFile/ManifestFile and which could be used to evaluate the filter expression based on the schema.
To support the migration of tables from one catalog to another catalog seamlessly, we have added [#5037 , #4946]. But still, bulk migration is hard as the API user needs...
This adds a FileIO implementation using [s3fs](https://github.com/fsspec/s3fs) as well as a test running environment using a docker-compose config.
We should consider refactoring these in a follow up PR so the table is partitioned by date. I've encountered this confusion as well before. _Originally posted by @kbendick in https://github.com/apache/iceberg/pull/5050#discussion_r933426976_
Co-authored-by: Kyle Bendickson [email protected] ## What is the purpose of the change There is a preliminary proposal: https://docs.google.com/document/d/1G4O6JidAoKgbIdy8Ts73OfG_KBEMpsW-LkXIb89I5k8/edit?usp=sharing ## Motivation & Structure In Flink 1.12 the community focused on implementing...
Bumps avro from 1.9.2 to 1.11.1. [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a...
![dependabot[bot] avatar](https://avatars.githubusercontent.com/in/29110?v=4 "dependabot[bot] avatar"){kind=avatar}
Bumps [spotless-plugin-gradle](https://github.com/diffplug/spotless) from 6.8.0 to 6.9.0. Commits 4085c79 Published gradle/6.9.0 a474435 Published lib/2.28.0 d6e767a Adapt gradle plugin publishing for the new 1.0 plugin-publish plugin. c229c19 Support adding license header for...
