sagemaker-spark icon indicating copy to clipboard operation
sagemaker-spark copied to clipboard

Share information about which Maven repo to download this from

Open mridang opened this issue 2 years ago • 0 comments

Hi. We're unable to use this in our builds since this seems to baked in to the EMR cluster. The docs say that EMR provides it's own repository https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-artifact-repository.html however we cannot find this.

Please could you share the repository URL and the GAV definition about where this can be found? for example:

    <dependency>
        <groupId>com.amazonaws.glue</groupId>
        <artifactId>sagemaker-spark</artifactId>
        <version>spark_3.0.1-amzn-0-1.4.1</version>
    </dependency>

I can see this on my Spark classpath on EMR 6.1.0 as /usr/share/aws/sagemaker-spark-sdk/lib/sagemaker-spark-sdk.jar with the version spark_3.0.1-amzn-0-1.4.1. Where can we find this?

mridang avatar Aug 04 '21 08:08 mridang