Manu Zhang comments

Results 93 comments of


                                            Manu Zhang

Spark: Fix a separate table cache being created for each rewriteFiles

Not sure. The furthest I can track is https://github.com/apache/iceberg/pull/2591 and the behavior is same as now.

Spark: Fix a separate table cache being created for each rewriteFiles

@rdblue Any more concerns or suggestions for this PR?

Spark: Fix a separate table cache being created for each rewriteFiles

@rdblue and @kbendick any more comments?

Spark: Fix a separate table cache being created for each rewriteFiles

Gentle ping @rdblue @aokolnychyi @kbendick for another review

Spark: Fix a separate table cache being created for each rewriteFiles

@ajantha-bhat I forgot to remove cloneSession in `SparkSortStrategy` and `SparkZOrderStrategy`. Please review again.

Spark: Fix a separate table cache being created for each rewriteFiles

@ajantha-bhat @rdblue any more comments?

Spark: Fix a separate table cache being created for each rewriteFiles

@RussellSpitzer please check again whether it's fixed now.

Spark: Fix a separate table cache being created for each rewriteFiles

@RussellSpitzer @rdblue @ajantha-bhat please take another look. Thanks.

Spark: Fix a separate table cache being created for each rewriteFiles

Thanks @rdblue @ajantha-bhat @RussellSpitzer @kbendick @hililiwei for your review. I opened #6284 and #6285 to back-port the PR to Spark 3.2 and 3.1 respectively. Please help review those PRs as...

Allow to set multiple folders for PEX_ROOT

On our cluster, we usually have two disks on a node and we won't decommission the node if only one disk is full or unhealthy. Say the two disks are...