incubator-gluten
incubator-gluten copied to clipboard
apache
[CORE] Upgrade Arrow to 15.0.0
Thanks for opening a pull request!
Could you open an issue for this pull request on Github Issues?
https://github.com/apache/incubator-gluten/issues
Then could you also rename commit message and pull request title in the following format?
[GLUTEN-${ISSUES_ID}][COMPONENT]feat/fix: ${detailed message}
See also:
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "Published by a pub.dev verified publisher"){kind=small}
Hi @Yohahaha, could you rebase this pr? I note we need this upgrade to avoid an invalid pointer issue. Thanks!
Hi @Yohahaha, it's strange that a few UT fails. Do you have any clues?
sorry, I dont have enough time to find root cause and continue iterating this PR for now. It would be great if community could take it.
===== Performance report for TPCH SF2000 with Velox backend, for reference only ====
| query | log/native_5174_time.csv | log/native_master_04_25_2024_8ade7a9cb_time.csv | difference | percentage |
| q1 | 37.26 | 36.23 | -1.029 | 97.24% |
| q2 | 23.91 | 23.67 | -0.232 | 99.03% |
| q3 | 37.26 | 39.09 | 1.838 | 104.93% |
| q4 | 38.60 | 37.31 | -1.284 | 96.67% |
| q5 | 71.02 | 69.05 | -1.965 | 97.23% |
| q6 | 7.64 | 5.64 | -1.997 | 73.86% |
| q7 | 84.03 | 84.14 | 0.105 | 100.13% |
| q8 | 85.33 | 85.57 | 0.244 | 100.29% |
| q9 | 120.92 | 123.29 | 2.370 | 101.96% |
| q10 | 45.40 | 46.88 | 1.474 | 103.25% |
| q11 | 20.09 | 20.38 | 0.289 | 101.44% |
| q12 | 24.02 | 28.18 | 4.162 | 117.33% |
| q13 | 56.20 | 55.46 | -0.741 | 98.68% |
| q14 | 17.59 | 17.25 | -0.347 | 98.03% |
| q15 | 30.65 | 31.27 | 0.619 | 102.02% |
| q16 | 14.16 | 13.89 | -0.270 | 98.10% |
| q17 | 104.04 | 104.73 | 0.694 | 100.67% |
| q18 | 146.01 | 145.71 | -0.293 | 99.80% |
| q19 | 14.77 | 13.71 | -1.056 | 92.85% |
| q20 | 29.15 | 27.47 | -1.681 | 94.23% |
| q21 | 285.12 | 286.10 | 0.979 | 100.34% |
| q22 | 14.78 | 14.41 | -0.373 | 97.48% |
| total | 1307.94 | 1309.44 | 1.506 | 100.12% |
