audiogram icon indicating copy to clipboard operation
audiogram copied to clipboard

Replace the queue with AWS Lambda?

Open veltman opened this issue 8 years ago • 5 comments

Rendering a video on demand might be a good Lambda use case, need to investigate this further.

Potential upsides: No Redis, no queue, much more modular, much easier installation for the server/editor alone Potential downsides: AWS lock-in, AWS documentation nightmares, debugging nightmares, long delays for long videos, hard limit of 300s rendering time

veltman avatar Jul 25 '16 14:07 veltman

This might help: https://github.com/bbc/node-canvas-lambda-deps

veltman avatar Jul 28 '16 15:07 veltman

I know popup uses a lambda for their similar tool, and I think the TAL shortcut tool does as well, fwiw.

kookster avatar Aug 02 '16 19:08 kookster

The 300s (5min) time limit for the function can now be extended to 15min.

jrhoads avatar Nov 14 '18 16:11 jrhoads

You could potentially distribute the rendering of the video in segments across concurrent Lambdas and then concat the video segments with ffmpeg to speed the process up (and potentially get rid of the fifteen-minute limit).

nonoesp avatar Sep 03 '20 09:09 nonoesp

Let's just spin up an AWS Fargate instance run it till the rendering is done and kill it. It's almost similar to lambda, gets no limit on execution time, and can handle load and complexity.

jerriclynsjohn avatar Feb 10 '21 10:02 jerriclynsjohn