Xianyang Liu

Core: Add schema_id to ContentFile/ManifestFile

14

This is the first part of #4842. Add the schema id to DataFile/DeteFile/ManifestFile and which could be used to evaluate the filter expression based on the schema.

Parquet: Set parquet bloom filter config with compatible column name

2

This PR improves the config setting for the parquet bloom filter. 1. Log warn for those don't exist column or the column type is unsupported (boolean or complex data type)....

ARROW-17338: [Java] The maximum request memory of BaseVariableWidthVector should limit to Integer.MAX_VALUE

7

We got a IndexOutOfBoundsException: ``` 2022-08-03 09:33:34,076 Error executing query, currentState RUNNING, java.lang.RuntimeException: org.apache.spark.SparkException: Job aborted due to stage failure: Task 3315 in stage 5.0 failed 4 times, most recent...

Possible unhandled error from worker: ray::ParallelIteratorWorker.par_iter_next_batch()

3

The following erros are just error prints. It is a bug in ray and will be fixed in future. ```python 2020-12-01 20:44:59,081 ERROR worker.py:977 -- Possible unhandled error from worker:...

Support set placement group for Spark cluster.

Core: Avoid reading ManifestFile when create ManifestReader

5

This patch aims to reduce the time of Iceberg task planning. We notice the task plan could not benefit from ParallelIterator a lot when there are many manifest files to...

Build: Apply spotless for scala code

12

Closes #7695.

GH-3344: Adaptive compression for v2 page

2

### Rationale for this change Closes #3344 ### What changes are included in this PR? ### Are these changes tested? Yes, added UT. ### Are there any user-facing changes? Yes,...