aws-step-functions-data-science-sdk-python
aws-step-functions-data-science-sdk-python copied to clipboard
aws
Step Functions Data Science SDK for building machine learning (ML) workflows and pipelines on AWS
The library does not appear to have support for [Intrinsic Functions](https://states-language.net/spec.html#intrinsic-functions). Here is a [list of intrinsic functions](https://states-language.net/spec.html#appendix-b) available in aws states language.
``` workflow = InferencePipeline( preprocessor=..., estimator=..., inputs={ "train":TrainingInput(s3_data="..."), "test":TrainingInput(s3_data="...") }, ... ) ``` When you call `execute()` it will fail, saying `object of type TrainingInput is not JSON serializable`
Hi, Lets say I have a execution schema as follows: ``` execution_input = ExecutionInput( schema={ "PATH_INPUT": str, "DESTINATION_OUTPUT": str, "study_name": str, "ProcessingJobName": str, "input_code": str, "job_pk": str, "job_sk": str, }...
### Description Updated the contributing guide to include instructions on how to generate sphinx reference documentation locally Fixes #(issue) - **N/A** ### Why is the change necessary? Sphinx reference docs...
### Description Fix build failures due to Sagemaker ThrottlingException when running pipeline integration tests Fixes #(issue) - **N/A** ### Why is the change necessary? Recent build failures were due to...
Add ResultSelector support for Task, Map and Parallel states. *Issue #, if available:* https://github.com/aws/aws-step-functions-data-science-sdk-python/issues/95 --- #### Description of changes Adding new Amazon States Language payload template "ResultSelector" https://states-language.net/#payload-template This change...
### Description With this change, it will be possible to use: 1. Placeholders for input_path and output_path for all States (except Fail) 2. Placeholders for items_path for Map State 3....
Some AWS service integration are not supported by the sdk, for instance ECS/Fargate with callback pattern : https://docs.aws.amazon.com/step-functions/latest/dg/connect-supported-services.html. This PR improve service integration and support callback pattern for ECS/Fargate. 2...
Values from estimator not passing to the step function definition (JSON). Had to manually set it in json by editing the step function from console to make the training job...
HI, When code_location is used in estimator of TrainingStep(), the uploaded s3 path and sagemaker_submit_directory timestamp do not match(about 400 ms). This will cause the execution to fail. In SageMaker...
