sparkling
sparkling copied to clipboard
Use with AWS Glue
Is it recommended to use sparkling with AWS Glue?
AWS Glue is a serverless stack on top of Spark provided by EMR. It has some additional features to Spark, but spark context is available as normal.
Has anyone tried integrating with Glue?
@WarFox I feel like you might need to use the AWS Java SDK like https://docs.aws.amazon.com/AWSJavaSDK/latest/javadoc/com/amazonaws/services/glue/AWSGlueClient.html to communicate with AWS Glue.
But I'd be interested to know more about what you have in mind with "use sparkling with AWS Glue" do you have an example?