cai can

[SPARK-25342][CORE][SQL]Support rolling back a result stage and rerunning all result tasks when writing files

3

### What changes were proposed in this pull request? From this pr:https://github.com/apache/spark/pull/22112, we learn that currently we can't rollback and rerun a result stage, and just fail. And this new...

[SPARK-38639][HIVE]Ignore the corrupted rows that failed to deserialize in hive sequence table

5

### What changes were proposed in this pull request? Original pr: https://github.com/apache/spark/pull/35963 When reading the hive sequence table, you can switch whether to skip corrupt records that fail to be...

[SPARK-40455][CORE]Abort result stage directly when it failed caused by FetchFailedException

5

### What changes were proposed in this pull request? Abort result stage directly when it failed caused by FetchFailedException. ### Why are the changes needed? Here's a very serious bug：...

[SPARK-40045][SQL]Optimize the order of filtering predicates

11

### Why are the changes needed? ``` select id, data FROM testcat.ns1.ns2.table where id =2 and md5(data) = '8cde774d6f7333752ed72cacddb05126' and trim(data) = 'a' ``` Based on the SQL, we currently...

[#3264] feat(spark-connector): Support Iceberg time travel in SQL queries

5

### What changes were proposed in this pull request? Support Iceberg time travel in SQL queries ### Why are the changes needed? supports time travel in SQL queries using `TIMESTAMP...

[#3186] feat(spark-connector): Support Iceberg Spark Procedure

5

### What changes were proposed in this pull request? Support Iceberg Spark Procedure. ### Why are the changes needed? Support manage Iceberg metadata using Spark SQL. Fix: https://github.com/datastrato/gravitino/issues/3186 ### Does...

### What changes were proposed in this pull request? Support SparkSQL extended syntax in Iceberg, such as: ``` addPartitionField dropPartitionField replacePartitionField setWriteDistributionAndOrdering setIdentifierFields dropIdentifierFields createOrReplaceBranch createOrReplaceTag dropBranch dropTag ``` ###...

[Subtask] Support Iceberg metadata tables

1

### Describe the subtask Support Iceberg metadata tables ``` ENTRIES, FILES, DATA_FILES, DELETE_FILES, HISTORY, METADATA_LOG_ENTRIES, SNAPSHOTS, REFS, MANIFESTS, PARTITIONS, ALL_DATA_FILES, ALL_DELETE_FILES, ALL_FILES, ALL_MANIFESTS, ALL_ENTRIES, POSITION_DELETES ``` ### Parent issue https://github.com/datastrato/gravitino/issues/1571

[#2921] fix(catalog-lakehouse-iceberg): Add width param to bucket and truncate functions in Gravitino SortOrder

10

### What changes were proposed in this pull request? Add width param to bucket and truncate functions in Gravitino SortOrder. for example: change `bucket([id]) `to `bucket(10, id)` change `truncate([name]) `to...

[#3259] feat(spark-connector): Support atomic create or replace Iceberg table

2

### What changes were proposed in this pull request? Support atomic create or replace Iceberg table. ### Why are the changes needed? Support atomic create or replace Iceberg table. Fix:...