sparkling icon indicating copy to clipboard operation
sparkling copied to clipboard

Use with AWS Glue

Open WarFox opened this issue 5 years ago • 1 comments

Is it recommended to use sparkling with AWS Glue?

AWS Glue is a serverless stack on top of Spark provided by EMR. It has some additional features to Spark, but spark context is available as normal.

Has anyone tried integrating with Glue?

WarFox avatar Jun 03 '20 07:06 WarFox

@WarFox I feel like you might need to use the AWS Java SDK like https://docs.aws.amazon.com/AWSJavaSDK/latest/javadoc/com/amazonaws/services/glue/AWSGlueClient.html to communicate with AWS Glue.

But I'd be interested to know more about what you have in mind with "use sparkling with AWS Glue" do you have an example?

samrose avatar Sep 06 '20 18:09 samrose