stepfunctions2processing icon indicating copy to clipboard operation
stepfunctions2processing copied to clipboard

AWS Fargate get Input data in python with Step Function

Open anuborah opened this issue 4 years ago • 1 comments

I am implementing a Step Function where by need to get the Input data sent from Step function to AWS Fargate Tasks. Inside the container how to retrieve the Input data from Step Function and how to send the response to the Step Function. The project in ECS is written in python. Please help to suggest how to get the Input data from Step Function to AWS Fargate tasks in python.

anuborah avatar Mar 19 '20 00:03 anuborah

@anuborah I think that in your case you would need to customize step function fargate state to send a custom command to fargate task (something like here https://github.com/PacktPublishing/-Practical-Deep-Learning-on-the-Cloud/blob/master/5.3/serverless.yml#L91). If you have a lot of parameters, you can upload them to S3 and pass input and output S3 key to Fargate. After processing, Fargate can upload results to output S3 key and the next state can read from it. Let me know if you encounter any issues.

ryfeus avatar Mar 23 '20 20:03 ryfeus