ml-commons icon indicating copy to clipboard operation
ml-commons copied to clipboard

[FEATURE] Integrate new Action Type of Batch Transform in Connectors and support CRUD transform jobs in Ml-Commons Tasks

Open Zhangxunmt opened this issue 1 year ago • 0 comments

Is your feature request related to a problem? Add the Bath Prediction/Transform as a new action type in the AI Connector framework. Currently only SageMaker has GA the batch transform https://docs.aws.amazon.com/sagemaker/latest/dg/batch-transform.html. Bedrock is still in preview of the batch prediction jobs. This new action type "batch_transform" will map to the SageMaker batch transform job.

When the "batch_transform" is executed through the connector, a Ml-Task id will be returned immediately. Users needs to use this task id to query the offline batch transform job status through the Ml-Task APIs(https://opensearch.org/docs/latest/ml-commons-plugin/api/tasks-apis/index/).

Do you have any additional context? Add any other context or screenshots about the feature request here.

Zhangxunmt avatar May 31 '24 17:05 Zhangxunmt