Spark Serverless

Spark server provides Apache Spark in serverless configuration.

This repository is deployed to staroid cluster using ods python pacakge.

Quick start

Please visit https://github.com/open-datastudio/ods.

How it works

Spark on Kubernetes both provides Spark client mode and Cluster mode. That means if your spark application have access to Kubernetes API server, your application can create driver and executors itself.

Therefore, this project more focuses on providing Kubernetes API endpoint to the Spark application, with optimized Spark configuration for the Kubernetes and each cloud platform providers.

Spark client mode application

Spark cluster mode application

Get supported

Don't hesitate to create an issue and join our Slack channel.

For commercial support, please contact staroid.