pilotscope
pilotscope copied to clipboard
how to deploy IMBD on a Spark cluster?
Thank you for the great work!
Are there instructions on deploying the JOB-benchmark into Spark? Specifically, how to load IMBD to Spark and adapt the JOB queries to the Spark SQL syntax. Also, have you tested whether pilotscope supports a multi-node Spark cluster?
currently, we mainly focus on PostgreSQL. We have not try to load JOB into Spark because JOB is suitable of PostgreSQL in syntax. In addition, we only test pilotscope in single node for Spark