velox icon indicating copy to clipboard operation
velox copied to clipboard

Rewrite some common reduce patterns with array_sum and transform

Open Yuhta opened this issue 1 year ago • 2 comments

Summary: Lambda expression in Velox is interpreted instead of compiled like in Presto Java, this makes us losing in performance in places like reduce. By rewriting some common patterns of reduce, we improve the performance significantly (more than 45x on a query).

Also fix a bug in TryExpr where we are not checking enough space for result nulls.

Differential Revision: D59406443

Yuhta avatar Jul 05 '24 21:07 Yuhta

Deploy Preview for meta-velox canceled.

Name Link
Latest commit 8842fcc8785953f46d1c23fd8960bd518b096285
Latest deploy log https://app.netlify.com/sites/meta-velox/deploys/668c58aa5badc00008258160

netlify[bot] avatar Jul 05 '24 21:07 netlify[bot]

This pull request was exported from Phabricator. Differential Revision: D59406443

facebook-github-bot avatar Jul 05 '24 21:07 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D59406443

facebook-github-bot avatar Jul 08 '24 14:07 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D59406443

facebook-github-bot avatar Jul 08 '24 14:07 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D59406443

facebook-github-bot avatar Jul 08 '24 21:07 facebook-github-bot

This pull request has been merged in facebookincubator/velox@19be763371d6caaf8d0880b6c8920fb28358cf92.

facebook-github-bot avatar Jul 09 '24 14:07 facebook-github-bot

Conbench analyzed the 1 benchmark run on commit 19be7633.

There were no benchmark performance regressions. 🎉

The full Conbench report has more details.

conbench-facebook[bot] avatar Jul 09 '24 14:07 conbench-facebook[bot]