spark-bench icon indicating copy to clipboard operation
spark-bench copied to clipboard

Published 20 hours ago • verified publisher icon CODAIT

The querytime is incorrect since it is lazy evaluated

Open tobegit3hub opened this issue 4 years ago • 2 comments

Now the source code of spark-bench uses single scala time function to evaluate the execution time.

The time of querytime is incorrect if we just call the sql function which will return right now.

image

image

tobegit3hub avatar May 10 '21 07:05 tobegit3hub

Kind of similar with https://github.com/CODAIT/spark-bench/issues/161 .

tobegit3hub avatar May 10 '21 07:05 tobegit3hub

Querytime is the most important part here. Does this bug also affect other Sparkbench workloads?

eddytruyen avatar Jun 07 '21 12:06 eddytruyen