loki icon indicating copy to clipboard operation
loki copied to clipboard

lambda-promtail dlq - which one to use Asynchronous invocation or Destinations ?

Open suvisheshs opened this issue 1 year ago • 3 comments

On-Failure log recovery using SQS says You can configure lambda so that unsuccessfully processed messages will be sent to the DLQ but not says which way does. please clarify it.

There are 2 ways we can add it

  1. Asynchronous invocation image

  2. Destinations image

suvisheshs avatar May 02 '24 07:05 suvisheshs

@CCOLLOT IIRC you added the support for SQS as well as these docs. We don't use lambda promtail with SQS ourselves so I don't have an answer here off the top of my head.

cstyan avatar May 02 '24 21:05 cstyan

Hi, when implementing this feature I was using the synchronous destinations mode. On failure, the event would be retried a few times before being sent to the DLQ. In this mode you need to have enough concurrency on your lambda function to handle incoming events. I suppose it should work with the asynchronous mode as well, but I'm not sure the payload schema is the same so it might require some adjustments.

CCOLLOT avatar May 03 '24 07:05 CCOLLOT

@CCOLLOT thanks for your reply :+1:

cstyan avatar May 03 '24 19:05 cstyan