spark-tpc-ds-performance-test

spark-tpc-ds-performance-test copied to clipboard

Cannot complete the test run

11

Hello, I following the instruction to do a local test run. First 3 steps completed successfully. At step 4, the table creation completed in about 10+ minutes. It is longer...

HarryLiUS

We should provide a way to run this tools in background for it is a long live time process while run a test for 10TB scale.

maobaolong

Howo do I actually change the scale factor

2

I do not see any way to do that.

v-olmedo

I am trying to create tables with 1GB pregenerated data from the repo. ============================================== TPC-DS On Spark Menu ---------------------------------------------- SETUP (1) Create spark tables RUN (2) Run a subset of...

ShamiSantosh

Query14.sql file has same query repeated twice,as can be sen there two limit 100; and query contents is same ,there are two "with" statements,which indicates its mistakenly repeated.

ShahbazHortonworks

Hi there! I was trying to run tpcds test, but end up with the error: ./tpcdsspark.sh: line 315: /home/opc/spark-tpc-ds-performance-test/src/data/work/create_tables_temp.sql: No such file or directory ls: cannot access /home/opc/spark-tpc-ds-performance-test/src/data/src/ddl/individual/*.sql: No such...

filanovskiy

is there anywhere I can see results from someone running this? I'm comparing spark 2 vs 3

geofflangenderfer