ml-commons
ml-commons copied to clipboard
[FEATURE] Integrate new Action Type of Batch Transform in Connectors and support CRUD transform jobs in Ml-Commons Tasks
Is your feature request related to a problem? Add the Bath Prediction/Transform as a new action type in the AI Connector framework. Currently only SageMaker has GA the batch transform https://docs.aws.amazon.com/sagemaker/latest/dg/batch-transform.html. Bedrock is still in preview of the batch prediction jobs. This new action type "batch_transform" will map to the SageMaker batch transform job.
When the "batch_transform" is executed through the connector, a Ml-Task id will be returned immediately. Users needs to use this task id to query the offline batch transform job status through the Ml-Task APIs(https://opensearch.org/docs/latest/ml-commons-plugin/api/tasks-apis/index/).
Do you have any additional context? Add any other context or screenshots about the feature request here.