Eduard Tudenhoefner
Eduard Tudenhoefner
Thanks for reporting this issue. I took a look and upgraded Iceberg/Spark and some other dependencies as was suggested here. https://github.com/airbytehq/airbyte/pull/38283 should fix this
I've run all unit / integration tests locally and all of them passed. I also ran Airbyte locally and tested things where data was being streamed from Parquet files to...
@marcosmarxm could you review this please?
@marcosmarxm friendly reminder on this PR. I think it would be good to get this eventually in. Please let me know your thoughts about getting this in and I'll rebase...
can you also please update the respective docs?
> > can you also please update the respective docs? > > do you mean the branch & tagging doc? anywhere else? I mean in the Spark procedures section: https://github.com/apache/iceberg/blob/e5ad5ce4c09d1efcd26e3cf0bd27bcf8c06c2400/docs/spark-procedures.md#rewrite_data_files
@felixYyu could you please rebase and address https://github.com/apache/iceberg/pull/4602#discussion_r987088357 so that we can get this PR reviewed & merged?
thanks @gaborkaszab, will try and review it this week. You might also want to include @rdblue or @danielcweeks for a review.
Thanks @gaborkaszab. I think it still makes sense to have @danielcweeks and/or @rdblue review this PR as they always can provide meaningful input which ultimately makes the outcome better.
There's one unrelated CI failure: ``` 2024-02-21T17:07:51.8918624Z [ERROR] com.facebook.presto.execution.resourceGroups.db.TestDistributedQueuesDb.testResourceGroupConcurrencyThreshold Time elapsed: 0.048 s