sagemaker-spark

sagemaker-spark copied to clipboard

Upgrade Spark and PySpark version to 3.3.0

10

This commit upgrades following: - Spark version to 3.3.0 - PySpark version to 3.3.0 - Scala version to 2.12.16 - Python version to 3.7 This commit deprecates python 3.6 *Issue...

navinsoni

pyspark XGBoostSageMakerEstimator fails on .fit()

1

Please fill out the form below. ### System Information - **Spark or PySpark**: pyspark - **SDK Version**: latest (pip version 1.4.2), EMR 5.23.0 - **Spark Version**: 2.4.0 - **Algorithm (e.g....

torsjonas

protobuf.SageMakerProtobufFileFormat could not be instantiated

1

Please fill out the form below. ### System Information - **PySpark version**: 3.3.0 ### Describe the problem I have been trying to use sagemaker along with spark to train on...

Karrthik-Arya

Usage of Glue Data Catalog with sagemaker_pyspark

16

### System Information - **Spark or PySpark**: PySpark - **SDK Version**: v1.2.8 - **Spark Version**: v2.3.2 - **Algorithm (e.g. KMeans)**: n/a ### Describe the problem I'm following the instructions proposed...

mattiamatrix

Feature request: pyspark 3.0.0 version support

10

Please fill out the form below. ### System Information - **Spark or PySpark**: - **SDK Version**: - **Spark Version**: - **Algorithm (e.g. KMeans)**: ### Describe the problem When is pyspark...

halilduygulu

Please fill out the form below. ### System Information - **Spark or PySpark**: PySpark - **SDK Version**: 1.4.2 - **Spark Version**: 2.4.0 - **Algorithm (e.g. KMeans)**: N/A ### Describe the...

ohfloydo

Please fill out the form below. ### System Information - **Spark or PySpark**: spark - **SDK Version**: NA - **Spark Version**: 2.4.4 - **Algorithm (e.g. KMeans)**:NA ### Describe the problem...

3333qwe

Can't install pandas on EMR cluster

1

System Information - Spark 2.4.5 - EMR cluster 5.30.1 - Sagemaker notebook with sparkmagic kernel I try to install some python additional libraries on EMR cluster using install_pypi_package API. A...

czapol

Customer was using PySpark SDK with a notebook without public internet access, they configured the notebook in a way to connect to their regional sts endpoint not the global one,...

StrangeParadise

Hi. We're unable to use this in our builds since this seems to baked in to the EMR cluster. The docs say that EMR provides it's own repository https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-artifact-repository.html however...

mridang