spark-sql-perf
spark-sql-perf copied to clipboard
databricks
I've installed sbt-0.13.15 in my environment. I trigger "sbt packge" and meet the following exceptions:  Is there anyone meet the similar issue? And how can I fix this problem.
TPC-DS schemas are different between `spark-sql-perf` [TPCDSTables](https://github.com/databricks/spark-sql-perf/blob/master/src/main/scala/com/databricks/spark/sql/perf/tpcds/TPCDSTables.scala#L57-L542) and `spark-master/branch-3.1` [TPCDSBase](https://github.com/apache/spark/blob/master/sql/core/src/test/scala/org/apache/spark/sql/TPCDSBase.scala#L51-L548) (string v.s. char/varchar). For example; ``` // spark "reason" -> """ |`r_reason_sk` INT, |`r_reason_id` CHAR(16), |`r_reason_desc` CHAR(100) """.stripMargin, // spark-sql-perf...
I have installed spark-sql-perf using: 1. sudo yum install -y gcc make flex bison byacc git 2. cd /tmp/ 3. git clone https://github.com/databricks/tpcds-kit.git 4. cd tpcds-kit/tools 5. make OS=LINUX 6....
Hi, We are trying to run TPC-DS queries on spark-sql-perf on Spark 3.1. We tried in Databricks runtimes 7.3 LTS and 8.1. We are using the JAR - spark-sql-perf_2.12-0.5.1-SNAPSHOT.jar We...
This PR intends to update the TPCDS schema based on [the Spark codebase](https://github.com/apache/spark/blob/master/sql/core/src/test/scala/org/apache/spark/sql/TPCDSBase.scala). I've manually checked that tables can be generated in spark-3.0/3.1/master.
There are some problems When I excuted cmd according guide as following： # ./build/sbt help Using jdk8u275-b01 as default JAVA_HOME. Note, this will be overridden by -java-home if it is...
I tried to install binary following instructions. From main branch I do the following: build/sbt package and I get the following error: [info] Compiling 67 Scala sources to /home/mostro/workspace/nokia/alluxio/alluxiotest/spark-sql-perf/target/scala-2.12/classes... sbt.InvalidComponent:...
TPC-H related data could not be generated because dbgen writes to a file and not to stdout, as opposed to dsdgen. This patch dumps each table content and removes the...
