sagemaker-spark icon indicating copy to clipboard operation
sagemaker-spark copied to clipboard

Batch transform job using sagemaker_pyspark

Open KobaKhit opened this issue 4 years ago • 1 comments

Please fill out the form below.

System Information

  • PySpark:
  • latest:
  • 2.3.2:
  • XGBoost:

Describe the problem

Are you guys planning on implementing the Transformer class in sagemaker_pyspark? I know I am able to use SageMakerModel class to create an endpoint and transform a spark dataframe. It would also be useful to be able to transform a spark dataframe using a batch transform job without me having to worry about deleting the endpoint. Thank you.

Minimal repo / logs

  • Exact command to reproduce:

KobaKhit avatar Feb 17 '20 21:02 KobaKhit

hi there, thanks for your interest. unfortunately, we're not sure at the moment if this is something that we'll add anytime soon, but we're always reprioritizing our backlog based on customer feedback.

laurenyu avatar Feb 17 '20 21:02 laurenyu