Lauren Yu

Unfortunately, we don't have any plans to upgrade the current Spark version, but we are always re-evaluating our roadmap based on customer feedback!

hi there, thanks for your interest. unfortunately, we're not sure at the moment if this is something that we'll add anytime soon, but we're always reprioritizing our backlog based on...

hi @harthur, thanks for your interest! Unfortunately, we're not sure at the moment if it's something that we'll add anytime soon, but we're always reprioritizing our backlog based on customer...

Hi, thanks for using SageMaker Spark! XGBoostSageMakerEstimator uses Spark's LibSVMOutputWriter, which is rather restrictive in its schema validation: https://github.com/apache/spark/blob/930b90a84871e2504b57ed50efa7b8bb52d3ba44/mllib/src/main/scala/org/apache/spark/ml/source/libsvm/LibSVMRelation.scala#L79 I think the issue stems from the number of columns in...

sorry for the slow reply here. it looks like the code you're referencing is more about PySpark and Glue rather than this sagemaker-pyspark library, so apologies if some of my...

sorry for the delayed response. talked to @metrizable and it looks like https://github.com/awslabs/aws-glue-data-catalog-client-for-apache-hive-metastore probably contains the right class. ~~[the README](https://github.com/awslabs/aws-glue-data-catalog-client-for-apache-hive-metastore#building-the-hive-client) has instructions for building, but there's also [an open PR...

Thanks for the suggestion! We'll look into making this change, but can't promise it'll happen anytime soon. If this is something you'd like to see sooner, would you be interested...

sorry for the slow response here. I had actually started working on this awhile ago: https://github.com/aws/sagemaker-python-sdk/pull/941. There is already an entrypoint in this repository that could preserve the path of...

we can leave this issue open since I don't think there's an existing one yet for this

> Why does Sagemaker pass a train argument by default to the bash command? This is SageMaker's contract: https://docs.aws.amazon.com/sagemaker/latest/dg/your-algorithms-training-algo-dockerfile.html. Unfortunately, there's not a way to change that. What you can...