stepfunctions2processing
stepfunctions2processing copied to clipboard
AWS Fargate get Input data in python with Step Function
I am implementing a Step Function where by need to get the Input data sent from Step function to AWS Fargate Tasks. Inside the container how to retrieve the Input data from Step Function and how to send the response to the Step Function. The project in ECS is written in python. Please help to suggest how to get the Input data from Step Function to AWS Fargate tasks in python.
@anuborah I think that in your case you would need to customize step function fargate state to send a custom command to fargate task (something like here https://github.com/PacktPublishing/-Practical-Deep-Learning-on-the-Cloud/blob/master/5.3/serverless.yml#L91). If you have a lot of parameters, you can upload them to S3 and pass input and output S3 key to Fargate. After processing, Fargate can upload results to output S3 key and the next state can read from it. Let me know if you encounter any issues.