incubator-gluten icon indicating copy to clipboard operation
incubator-gluten copied to clipboard

[DNR] test simd cmp

Open zhli1142015 opened this issue 1 year ago • 27 comments

What changes were proposed in this pull request?

(Please fill in changes proposed in this fix)

(Fixes: #ISSUE-ID)

How was this patch tested?

(Please explain how this patch was tested. E.g. unit tests, integration tests, manual tests)

(If this patch involves UI changes, please attach a screenshot; otherwise, remove this)

zhli1142015 avatar Jun 20 '24 23:06 zhli1142015

Thanks for opening a pull request!

Could you open an issue for this pull request on Github Issues?

https://github.com/apache/incubator-gluten/issues

Then could you also rename commit message and pull request title in the following format?

[GLUTEN-${ISSUES_ID}][COMPONENT]feat/fix: ${detailed message}

See also:

github-actions[bot] avatar Jun 20 '24 23:06 github-actions[bot]

/Benchmark Velox TPCDS

zhli1142015 avatar Jun 21 '24 00:06 zhli1142015

/Benchmark TPCDS

zhli1142015 avatar Jun 21 '24 00:06 zhli1142015

/Benchmark Velox TPCH

zhli1142015 avatar Jun 21 '24 00:06 zhli1142015

/Benchmark TPCH

zhli1142015 avatar Jun 21 '24 00:06 zhli1142015

/Benchmark TPCH

zhli1142015 avatar Jun 21 '24 05:06 zhli1142015

/Benchmark TPCH

zhli1142015 avatar Jun 22 '24 10:06 zhli1142015

/Benchmark Velox TPCH

zhli1142015 avatar Jun 22 '24 10:06 zhli1142015

===== Performance report for TPCH SF2000 with Velox backend, for reference only ====

query log/native_6171_time.csv log/native_master_06_21_2024_ef7b2c516_time.csv difference percentage
q1 34.88 35.14 0.258 100.74%
q2 23.76 26.25 2.486 110.46%
q3 38.80 38.62 -0.180 99.54%
q4 32.73 34.48 1.751 105.35%
q5 70.85 70.26 -0.590 99.17%
q6 8.10 7.96 -0.144 98.22%
q7 82.11 85.08 2.975 103.62%
q8 87.40 83.21 -4.193 95.20%
q9 120.00 122.00 2.006 101.67%
q10 43.66 44.94 1.281 102.93%
q11 22.27 22.82 0.552 102.48%
q12 25.18 24.55 -0.631 97.49%
q13 38.23 38.63 0.400 101.05%
q14 18.01 18.18 0.171 100.95%
q15 31.46 30.13 -1.331 95.77%
q16 14.08 16.41 2.335 116.58%
q17 106.24 104.52 -1.714 98.39%
q18 147.66 148.17 0.511 100.35%
q19 13.87 13.73 -0.146 98.95%
q20 27.83 26.41 -1.415 94.92%
q21 262.59 262.85 0.258 100.10%
q22 12.35 12.55 0.204 101.65%
total 1262.06 1266.90 4.844 100.38%

GlutenPerfBot avatar Jun 22 '24 11:06 GlutenPerfBot

/Benchmark TPCH

zhli1142015 avatar Jun 24 '24 07:06 zhli1142015

/Benchmark Velox TPCH

zhli1142015 avatar Jun 24 '24 07:06 zhli1142015

/Benchmark TPCH

zhli1142015 avatar Jun 24 '24 13:06 zhli1142015

/Benchmark Velox TPCH

zhli1142015 avatar Jun 24 '24 13:06 zhli1142015

/Benchmark Velox TPCDS

zhli1142015 avatar Jun 24 '24 13:06 zhli1142015

===== Performance report for TPCH SF2000 with Velox backend, for reference only ====

query log/native_6171_time.csv log/native_master_06_23_2024_1e06169cd_time.csv difference percentage
q1 35.69 36.88 1.189 103.33%
q2 23.69 23.65 -0.037 99.84%
q3 40.62 42.16 1.540 103.79%
q4 31.83 33.05 1.219 103.83%
q5 70.08 69.90 -0.177 99.75%
q6 6.27 7.95 1.680 126.81%
q7 81.93 80.73 -1.204 98.53%
q8 84.98 82.15 -2.828 96.67%
q9 123.74 119.99 -3.746 96.97%
q10 48.11 46.07 -2.038 95.76%
q11 20.06 20.48 0.423 102.11%
q12 29.25 26.53 -2.718 90.71%
q13 37.90 38.12 0.218 100.57%
q14 22.30 18.74 -3.561 84.03%
q15 29.96 32.95 2.982 109.95%
q16 13.93 14.22 0.294 102.11%
q17 104.18 104.72 0.536 100.51%
q18 147.92 148.08 0.161 100.11%
q19 16.93 14.64 -2.289 86.48%
q20 26.23 30.40 4.172 115.91%
q21 260.58 261.83 1.250 100.48%
q22 12.06 12.33 0.277 102.30%
total 1268.24 1265.58 -2.659 99.79%

GlutenPerfBot avatar Jun 24 '24 14:06 GlutenPerfBot

===== Performance report for TPCDS SF2000 with Velox backend, for reference only ====

query log/native_6171_time.csv log/native_master_06_23_2024_1e06169cde_time.csv difference percentage
q1 14.04 14.36 0.321 102.28%
q2 11.68 17.41 5.734 149.11%
q3 8.02 4.39 -3.629 54.73%
q4 64.22 63.67 -0.554 99.14%
q5 7.88 7.83 -0.049 99.37%
q6 3.93 4.33 0.401 110.21%
q7 5.92 6.31 0.395 106.67%
q8 5.42 5.15 -0.267 95.07%
q9 19.90 17.06 -2.841 85.72%
q10 12.01 11.81 -0.202 98.32%
q11 41.24 36.31 -4.930 88.04%
q12 2.55 2.74 0.193 107.57%
q13 5.45 6.44 0.996 118.28%
q14a 42.25 41.21 -1.039 97.54%
q14b 43.03 42.82 -0.212 99.51%
q15 2.58 2.74 0.164 106.37%
q16 38.32 38.75 0.431 101.13%
q17 4.98 4.69 -0.298 94.02%
q18 6.43 6.41 -0.014 99.79%
q19 2.33 3.24 0.905 138.80%
q20 1.26 1.37 0.105 108.36%
q21 1.01 4.09 3.078 404.78%
q22 11.50 7.99 -3.508 69.49%
q23a 81.39 84.91 3.521 104.33%
q23b 104.68 102.60 -2.083 98.01%
q24a 80.89 80.62 -0.264 99.67%
q24b 68.43 78.10 9.669 114.13%
q25 4.51 4.30 -0.205 95.45%
q26 4.20 2.64 -1.560 62.86%
q27 3.09 3.09 -0.005 99.84%
q28 29.89 23.43 -6.466 78.37%
q29 7.32 7.25 -0.073 99.00%
q30 4.59 4.23 -0.359 92.18%
q31 6.18 7.54 1.358 121.97%
q32 1.21 1.18 -0.036 97.03%
q33 4.79 4.77 -0.025 99.47%
q34 3.77 3.70 -0.068 98.19%
q35 6.55 8.88 2.330 135.57%
q36 3.38 3.50 0.115 103.39%
q37 5.47 4.04 -1.437 73.74%
q38 11.84 12.05 0.206 101.74%
q39a 3.33 4.14 0.814 124.43%
q39b 6.34 2.98 -3.358 47.04%
q40 3.65 4.71 1.057 128.98%
q41 0.62 0.57 -0.056 91.09%
q42 0.99 0.95 -0.047 95.28%
q43 3.59 5.56 1.976 155.11%
q44 8.75 8.92 0.170 101.94%
q45 3.54 3.56 0.022 100.62%
q46 3.16 3.22 0.059 101.86%
q47 14.59 14.40 -0.194 98.67%
q48 4.51 4.60 0.086 101.91%
q49 9.74 13.37 3.626 137.21%
q50 23.32 20.89 -2.427 89.59%
q51 8.58 8.48 -0.097 98.86%
q52 1.00 1.09 0.094 109.46%
q53 2.04 1.93 -0.113 94.49%
q54 3.29 3.23 -0.058 98.24%
q55 1.07 0.97 -0.102 90.51%
q56 4.35 4.60 0.256 105.90%
q57 8.58 8.59 0.013 100.15%
q58 2.63 2.51 -0.111 95.77%
q59 11.11 16.42 5.313 147.82%
q60 7.17 4.76 -2.405 66.45%
q61 5.36 5.36 -0.005 99.90%
q62 3.65 4.59 0.940 125.77%
q63 2.06 2.17 0.110 105.36%
q64 48.73 48.21 -0.525 98.92%
q65 14.57 15.52 0.951 106.52%
q66 5.78 3.47 -2.307 60.08%
q67 345.89 353.26 7.363 102.13%
q68 3.85 3.97 0.126 103.28%
q69 6.78 10.93 4.146 161.15%
q70 12.21 8.82 -3.389 72.25%
q71 2.54 2.25 -0.294 88.44%
q72 190.91 192.25 1.346 100.70%
q73 3.55 2.83 -0.716 79.81%
q74 21.47 21.44 -0.032 99.85%
q75 23.19 23.26 0.074 100.32%
q76 9.65 11.74 2.092 121.69%
q77 2.19 2.30 0.106 104.82%
q78 42.38 39.08 -3.302 92.21%
q79 3.57 3.45 -0.119 96.68%
q80 11.41 14.92 3.513 130.78%
q81 5.27 5.00 -0.271 94.85%
q82 10.28 6.85 -3.426 66.67%
q83 1.68 1.53 -0.152 90.96%
q84 2.90 2.76 -0.140 95.17%
q85 6.77 6.53 -0.235 96.53%
q86 4.89 3.28 -1.603 67.20%
q87 12.14 13.58 1.440 111.86%
q88 25.57 27.59 2.030 107.94%
q89 3.34 3.32 -0.021 99.37%
q90 9.41 4.50 -4.912 47.79%
q91 2.57 2.63 0.057 102.23%
q92 1.32 1.38 0.062 104.71%
q93 28.74 28.76 0.028 100.10%
q94 21.33 21.10 -0.237 98.89%
q9 84.11 82.75 -1.357 98.39%
q5 3.90 3.30 -0.596 84.71%
q96 12.63 12.36 -0.270 97.86%
q97 2.07 2.10 0.028 101.37%
q98 8.96 9.52 0.560 106.25%
q99 8.96 9.52 0.560 106.25%
total 1931.66 1937.03 5.375 100.28%

GlutenPerfBot avatar Jun 24 '24 15:06 GlutenPerfBot

===== Performance report for TPCH SF2000 with Velox backend, for reference only ====

query log/native_6171_time.csv log/native_master_06_23_2024_1e06169cd_time.csv difference percentage
q1 35.62 36.88 1.261 103.54%
q2 23.39 23.65 0.262 101.12%
q3 38.98 42.16 3.184 108.17%
q4 31.35 33.05 1.704 105.44%
q5 72.14 69.90 -2.239 96.90%
q6 6.40 7.95 1.547 124.17%
q7 85.21 80.73 -4.487 94.73%
q8 86.28 82.15 -4.126 95.22%
q9 123.66 119.99 -3.672 97.03%
q10 46.46 46.07 -0.392 99.16%
q11 20.55 20.48 -0.068 99.67%
q12 25.16 26.53 1.374 105.46%
q13 40.24 38.12 -2.121 94.73%
q14 18.04 18.74 0.696 103.86%
q15 32.88 32.95 0.071 100.22%
q16 14.25 14.22 -0.025 99.82%
q17 105.91 104.72 -1.192 98.87%
q18 149.44 148.08 -1.357 99.09%
q19 13.84 14.64 0.804 105.81%
q20 32.02 30.40 -1.622 94.94%
q21 262.62 261.83 -0.792 99.70%
q22 12.33 12.33 0.008 100.07%
total 1276.76 1265.58 -11.184 99.12%

GlutenPerfBot avatar Jun 24 '24 16:06 GlutenPerfBot

/Benchmark Velox TPCH

zhli1142015 avatar Jun 25 '24 08:06 zhli1142015

/Benchmark Velox TPCDS

zhli1142015 avatar Jun 25 '24 08:06 zhli1142015

===== Performance report for TPCH SF2000 with Velox backend, for reference only ====

query log/native_6171_time.csv log/native_master_06_24_2024_f07e348f4_time.csv difference percentage
q1 36.11 35.39 -0.714 98.02%
q2 23.67 23.65 -0.021 99.91%
q3 41.11 40.35 -0.765 98.14%
q4 31.23 32.68 1.452 104.65%
q5 70.92 70.64 -0.278 99.61%
q6 10.62 9.08 -1.543 85.47%
q7 82.54 80.58 -1.960 97.63%
q8 85.16 87.90 2.738 103.21%
q9 119.05 125.50 6.449 105.42%
q10 47.31 48.85 1.541 103.26%
q11 20.21 20.45 0.240 101.19%
q12 27.09 26.51 -0.575 97.88%
q13 38.32 38.63 0.306 100.80%
q14 19.22 22.31 3.096 116.11%
q15 32.73 31.83 -0.898 97.26%
q16 14.56 14.13 -0.436 97.01%
q17 104.38 103.74 -0.644 99.38%
q18 149.05 144.47 -4.578 96.93%
q19 13.89 13.92 0.038 100.27%
q20 31.08 29.16 -1.919 93.83%
q21 262.60 264.29 1.696 100.65%
q22 12.11 12.24 0.122 101.01%
total 1272.95 1276.30 3.349 100.26%

GlutenPerfBot avatar Jun 25 '24 09:06 GlutenPerfBot

===== Performance report for TPCDS SF2000 with Velox backend, for reference only ====

query log/native_6171_time.csv log/native_master_06_24_2024_f07e348f4d_time.csv difference percentage
q1 14.75 19.21 4.459 130.22%
q2 13.39 14.16 0.769 105.75%
q3 4.38 3.95 -0.431 90.15%
q4 63.58 62.97 -0.618 99.03%
q5 7.97 7.87 -0.101 98.74%
q6 3.53 2.50 -1.028 70.88%
q7 6.43 5.49 -0.944 85.33%
q8 5.85 5.08 -0.765 86.93%
q9 20.62 22.45 1.825 108.85%
q10 11.03 11.33 0.298 102.70%
q11 35.77 35.20 -0.564 98.42%
q12 1.46 1.47 0.013 100.92%
q13 9.13 5.37 -3.756 58.84%
q14a 41.45 43.48 2.021 104.88%
q14b 40.66 41.98 1.316 103.24%
q15 2.72 2.63 -0.086 96.85%
q16 38.15 38.68 0.532 101.39%
q17 4.84 7.38 2.546 152.61%
q18 7.35 6.61 -0.746 89.85%
q19 2.47 2.22 -0.247 89.97%
q20 1.51 2.59 1.080 171.35%
q21 1.12 1.18 0.059 105.24%
q22 9.73 9.87 0.132 101.36%
q23a 82.80 83.09 0.285 100.34%
q23b 102.59 100.62 -1.973 98.08%
q24a 73.92 73.78 -0.143 99.81%
q24b 78.93 67.56 -11.364 85.60%
q25 6.16 5.96 -0.201 96.74%
q26 3.22 2.94 -0.282 91.23%
q27 3.24 3.16 -0.072 97.79%
q28 26.29 24.23 -2.055 92.18%
q29 7.24 6.98 -0.265 96.34%
q30 4.06 4.33 0.267 106.57%
q31 6.22 7.92 1.706 127.45%
q32 1.10 1.03 -0.070 93.58%
q33 4.64 4.87 0.239 105.15%
q34 3.40 3.83 0.437 112.87%
q35 6.44 7.86 1.419 122.04%
q36 3.30 3.44 0.148 104.50%
q37 4.10 4.10 -0.003 99.93%
q38 11.75 11.63 -0.117 99.00%
q39a 3.52 3.22 -0.297 91.57%
q39b 3.15 5.12 1.972 162.68%
q40 3.54 3.92 0.380 110.75%
q41 0.60 0.60 -0.003 99.48%
q42 0.90 0.89 -0.008 99.15%
q43 3.54 3.73 0.189 105.33%
q44 8.95 8.56 -0.381 95.74%
q45 3.63 3.60 -0.035 99.05%
q46 3.24 3.37 0.131 104.05%
q47 14.50 14.18 -0.322 97.78%
q48 4.31 4.58 0.274 106.36%
q49 9.77 10.03 0.254 102.60%
q50 24.50 23.93 -0.563 97.70%
q51 8.52 8.64 0.123 101.44%
q52 0.99 1.05 0.057 105.74%
q53 1.97 2.03 0.060 103.04%
q54 3.33 3.21 -0.117 96.48%
q55 0.97 0.95 -0.016 98.31%
q56 4.37 4.37 0.002 100.06%
q57 9.15 8.62 -0.528 94.23%
q58 3.37 2.70 -0.675 79.98%
q59 14.95 13.99 -0.962 93.57%
q60 4.98 6.49 1.512 130.35%
q61 5.69 5.53 -0.169 97.03%
q62 4.40 4.80 0.397 109.03%
q63 2.34 2.28 -0.059 97.47%
q64 49.15 49.93 0.781 101.59%
q65 13.66 13.70 0.033 100.25%
q66 3.38 3.36 -0.015 99.57%
q67 344.15 350.98 6.830 101.98%
q68 3.89 3.69 -0.196 94.95%
q69 10.05 6.13 -3.919 61.00%
q70 9.37 11.04 1.661 117.71%
q71 2.31 3.07 0.757 132.75%
q72 188.59 191.38 2.797 101.48%
q73 2.21 2.72 0.516 123.38%
q74 23.69 21.09 -2.595 89.04%
q75 23.35 23.11 -0.238 98.98%
q76 9.42 9.27 -0.153 98.37%
q77 2.30 2.07 -0.233 89.91%
q78 42.89 43.31 0.423 100.99%
q79 3.65 3.43 -0.217 94.05%
q80 11.55 11.26 -0.293 97.46%
q81 5.17 5.05 -0.125 97.58%
q82 10.24 9.66 -0.582 94.31%
q83 1.49 1.61 0.126 108.47%
q84 2.86 2.67 -0.193 93.26%
q85 9.88 6.70 -3.179 67.82%
q86 3.23 3.29 0.064 101.98%
q87 11.97 12.25 0.278 102.33%
q88 25.23 24.67 -0.555 97.80%
q89 3.29 3.17 -0.119 96.38%
q90 7.76 10.11 2.347 130.22%
q91 2.57 2.68 0.101 103.94%
q92 1.25 1.30 0.050 103.95%
q93 28.92 28.82 -0.096 99.67%
q94 21.02 21.20 0.176 100.84%
q9 86.09 84.22 -1.873 97.82%
q5 3.43 3.49 0.055 101.62%
q96 12.29 12.33 0.037 100.30%
q97 2.04 1.94 -0.104 94.93%
q98 9.21 9.42 0.217 102.36%
q99 9.21 9.42 0.217 102.36%
total 1918.02 1915.52 -2.500 99.87%

GlutenPerfBot avatar Jun 25 '24 10:06 GlutenPerfBot

/Benchmark Velox TPCH

zhli1142015 avatar Jun 27 '24 05:06 zhli1142015

/Benchmark Velox TPCDS

zhli1142015 avatar Jun 27 '24 05:06 zhli1142015

/Benchmark Velox TPCH

zhli1142015 avatar Jun 27 '24 10:06 zhli1142015

/Benchmark Velox TPCDS

zhli1142015 avatar Jun 27 '24 10:06 zhli1142015

/Benchmark Velox TPCDS

zhli1142015 avatar Jun 28 '24 05:06 zhli1142015

/Benchmark Velox TPCH

zhli1142015 avatar Jun 28 '24 05:06 zhli1142015