sagemaker-spark
sagemaker-spark copied to clipboard
Batch transform job using sagemaker_pyspark
Please fill out the form below.
System Information
- PySpark:
- latest:
- 2.3.2:
- XGBoost:
Describe the problem
Are you guys planning on implementing the Transformer class in sagemaker_pyspark? I know I am able to use SageMakerModel class to create an endpoint and transform a spark dataframe. It would also be useful to be able to transform a spark dataframe using a batch transform job without me having to worry about deleting the endpoint. Thank you.
Minimal repo / logs
- Exact command to reproduce:
hi there, thanks for your interest. unfortunately, we're not sure at the moment if this is something that we'll add anytime soon, but we're always reprioritizing our backlog based on customer feedback.