spark-on-lambda
spark-on-lambda copied to clipboard
Dockerize Spark on Lambda with jupyter notebook.
Idea here is creating a docker image for Spark on Lambda so that Spark Driver can be spun up on either AWS ECS or on Fargate. It would be nicer if there is a frontend of jupyter notebook interfacing with the Spark app.