Mingliang Zhu
Mingliang Zhu
### Description In production, we encountered a situation where the consumption of r2c large table was far greater than the performance improvement brought by native, so I considered using RAS...
## What changes were proposed in this pull request? Fixes: \#7589 ## How was this patch tested?
### Description Velox already supports date_trunc of presto, which seems to be reusable for spark.
### Backend VL (Velox) ### Bug description ``` spark.sql("set spark.gluten.enabled=false") spark.range(100).selectExpr("id%2 as c1", "id%5 as c2", "id as c3").write.mode("overwrite").parquet("tmp/t1") spark.sql("set spark.gluten.enabled=true") spark.read.parquet("tmp/t1").createOrReplaceTempView("t1") spark.sql("select c2, sum(c3) from t1 where c1= 1...
### Bug description Write parquet file requires disable gluten. ``` spark.sql("set spark.gluten.enabled=false") spark.range(1000).selectExpr("id%2 as c1", "id%5 as c2", "id as c3").write.mode("overwrite").parquet("tmp/t1") spark.sql("set spark.gluten.enabled=true") spark.read.parquet("tmp/t1").createOrReplaceTempView("t1") spark.sql("select c2, sum(c3) from t1 where...
### What changes were proposed in this pull request? Continue #52210. Introduced three concurrent hash maps to track block ID associations for optimize BlockManager remove operations by introducing cached mappings...
### Bug description Found in https://github.com/facebookincubator/velox/actions/runs/19432747435/job/55604321168 ``` Error Source: USER Error Code: ARITHMETIC_ERROR Reason: integer overflow: 41 * 1009040550 Retriable: False Context: repeat()zi8n-ps,`Op^7g&W-dMU!aG(mSVrS>yF;32.@W(j:VARCHAR, 1009040550:INTEGER) Function: checkedMultiply File: /__w/velox/velox/velox/./velox/common/base/CheckedArithmetic.h Line: 51...
Support legacy date formatter for Spark date_format function.