aws-lambda-stream
aws-lambda-stream copied to clipboard
jgilbert01
Create stream processors with AWS Lambda functions
To be consistent with other functions that we pass to rules (toUpdateRequest etc.) that have signature `(uow, rule) => ...` can we have similar signature for `compact.group` function? Changing [this](https://github.com/jgilbert01/aws-lambda-stream/blob/0bad9663c2139c2b41f98d16a015142242dab1c6/src/utils/batch.js#L33):...
We have a use-case where we want to retrieve the claim/check in fromKinesis, but still have access to the raw claim entry to forward it along downstream. We implemented this...
We've been able to use the publishToEventBridge -> Rule -> Kinesis -> Lambda pattern for many of our services. However, for services for which there's no other consumers of the...
When upgrading to Node version 20, I had to update this library to the latest version (v1) that supports AWS SDK V3. I've encountered several breaking changes, including changes to...
How would you seed a new subsystem with historical data ? Example usecase: - `Subsys X` has an egress-esg that emits external events and store them to its event lake...
[Here](https://github.com/jgilbert01/aws-lambda-stream/blob/e00f09e1922a4a6d5cc86ccd3d7ddcdce2d0a3b1/src/faults/index.js#L13C3-L13C9) `logErr` is called before `if (err.uow...` check. It [calls](https://github.com/jgilbert01/aws-lambda-stream/blob/e00f09e1922a4a6d5cc86ccd3d7ddcdce2d0a3b1/src/faults/index.js#L90C19-L90C35) `err.uow.pipeline` which throws `Cannot read properties of undefined (reading 'pipeline')` if error was not properly handled with `faulty` etc. In...
- fromFirehose - toFirehose - https://github.com/jgilbert01/templates/blob/master/template-event-lake-es/src/transform/index.js
Right now it transforms with [transformToString()](https://github.com/jgilbert01/aws-lambda-stream/blob/71d1c37a8b7687df9c62affc179ee5bb457cfefa/src/connectors/s3.js#L75C75-L75C94) I need to use `.transformToByteArray()` instead (transforming string to byte array doesn't give same result as when transforming with transformToByteArray() from the start) I...
Metadata
Owner
Metadata
Create stream processors with AWS Lambda functions