pilotscope icon indicating copy to clipboard operation
pilotscope copied to clipboard

how to deploy IMBD on a Spark cluster?

Open Angryrou opened this issue 1 year ago • 1 comments

Thank you for the great work!

Are there instructions on deploying the JOB-benchmark into Spark? Specifically, how to load IMBD to Spark and adapt the JOB queries to the Spark SQL syntax. Also, have you tested whether pilotscope supports a multi-node Spark cluster?

Angryrou avatar Jul 03 '24 14:07 Angryrou

currently, we mainly focus on PostgreSQL. We have not try to load JOB into Spark because JOB is suitable of PostgreSQL in syntax. In addition, we only test pilotscope in single node for Spark

duoyw avatar Aug 28 '24 03:08 duoyw