docs icon indicating copy to clipboard operation
docs copied to clipboard

Examples on fire and forget models

Open ykethan opened this issue 1 year ago • 0 comments

Is your feature request related to a problem? Please describe. Issue: https://github.com/aws-amplify/amplify-backend/issues/2026#issuecomment-2361540853

The Fire and Forget model seems to have limited applications from a first glance... Jobs taking longer than 30 secs would benefit from a mechanism to poll/monitor progress and completion, I think...

My need right now is to recursively poll an FTP server for file paths carrying specific prefixes, build a list of file paths that need to be download then transfer the download requests to Fargate tasks on ECS to copy the file on S3. Surveying the FTP server takes some time (usually less than 30 seconds but depending on latency sometime up to a minute or so...). The files can be pretty massive, ranging from a few Gb close to a fraction of Tb, hence passing the copy request to Fargate.

Thanks for any suggestions. Adding more patterns to the docs could prove helpful!

Describe the solution you'd like examples providing this pattern

ykethan avatar Sep 24 '24 19:09 ykethan