kinsumer

kinsumer copied to clipboard

Enhanced Fan-Out

2

Thoughts on supporting enhanced fan-out? https://docs.aws.amazon.com/streams/latest/dev/introduction-to-enhanced-consumers.html

nickpoorman

Provide access to the kinesis.Record object when fetching data since it has some metadata that is useful to expose.

MarkSRobinson

Manually update checkpoint

3

Hi! Is it possible to manually update the checkpoint manually? My use case is that the processing of a record can fail temporarily and I would like to be able...

Sytten

how to define initial position in stream

6

Hi. I'd like to define initial position in stream, but I don't see how to define such parameter in `kinsumer.NewConfig()` Thank you

jney

Add Manual Checkpointing

10

This adds a new config option, `WithManualCheckpointing(true)`, that disables the automatic checkpoint on `Next()` and adds a new method `NextWithCheckpointer()` that includes a new return argument, `func()`, which updates the...

FugiTech

added support for deaggregation for aggregated records

1

This PR enables support for deaggregation of the records if the stream has aggregated records.

psanzay

Application Ids and Concurrent Apps using Kinsumer

1

(First of all: thanks for being awesome-y) Not really an issue, but a question: How relevant are application ids with parallelization? We'd like to run two kinsumer instances of the...

aldrinleal

add ResetCheckpoints function

1

Adds a `ResetCheckpoints` function which sets all existing dynamo checkpoints to `LATEST`. This is useful to call as part of a deploy if you want to make sure that all...

frrad

<InvalidSignatureException message>Credential should be scoped to correct service: 'kinesis'

1

I tried to use the sample consumer and passsign the region and all other details under aws config but keep getting below error Credential should be scoped to correct service:...

pradeepkusingh

Using kinsumer cross aws accounts delays/ lose the data

6

I am using kinsumer cross accounts and can see significant delay and sometimes lossing data while reading from Next(). in the same account as kinesis, kinsumer works fine but not...

rhythmsharma