Harpreet Kaur Chawla
Harpreet Kaur Chawla
Go to this directory -> spark-sql-perf-master/src/main/scala/com/databricks/spark/sql/perf and in file RunBenchmark.scala change .setMaster("local[*]") to pint to your master. Hopefully this should work
Can you paste the errors you are getting by running bin/run --benchmark DatasetPerformance ? This is the default test suite/test case or benchmark class and once you are able to...
I don't see any error. Let the program run completely. This is not complete log.
NoSuchMethodError usually means that you have incompatibility between libraries..... I think default scala for Spark 1.6.1 is 2.10 (you can try that)
can you verify your TPCDS.scala class: https://github.com/databricks/spark-sql-perf/blob/v0.4.3/src/main/scala/com/databricks/spark/sql/perf/tpcds/TPCDS.scala Are you using Spark2.0..
There are more API's in spark 2.0 (esp for spark sql perf)... from you spark-sql-perf-master directory try sbt it should give you command prompt ... then type compile and then...