Justin Pfifer

Results 66 comments of Justin Pfifer

The KCL attempts to retrieve records using a timed process. The value of `idleTimeBetweenReadsInMillis` controls how long it will sleep between calls to Kinesis. If it gets no records on...

Is your record processor getting called correctly with an empty list of records? Also where > Sleeping for 2 seconds coming from?

Can you follow the instructions in [issue #51](https://github.com/awslabs/amazon-kinesis-client-python/issues/51#issuecomment-316467366). This will allow configuration of the KCL's logging system. You will need to install [Apache Maven](https://maven.apache.org/) to build the script, but this...

Sorry I thought that comment had everything. This [comment](https://github.com/awslabs/amazon-kinesis-client-python/issues/51#issuecomment-302460792) has the steps to generate the launcher script. This generates a directory that contains all the jars, and startup scripts to...

It looks like it's getting [stuck waiting on the response from the initialize method](https://gist.github.com/jonathan-kosgei/ac6958cba7173e6fa06934dbbfb1774d#file-kinesis-logs-txt-L1072): > 20:42:27.998 [multi-lang-daemon-0004] INFO com.amazonaws.services.kinesis.multilang.LineReaderTask - Starting: Reading next message from STDIN for shardId-000000000000 20:42:28.085 [multi-lang-daemon-0000]...

Something weird is definitely going on. An interesting aside is when you use Control-C on the parent process it gets sent to the child process as well. Hence a Python...

The test output is from Python 3.5, but one possible difference is I'm using something like `#!/usr/local/bin/python3` in the record processor script. Alpine Linux shouldn't cause a problem, but I've...

Try setting `callProcessRecordsEvenForEmptyRecordList` to `true`. This will cause the KCL to call the record processor even if no records were retrieved. While the KCL calls Kinesis consistently it's possible that...

There is a request for a way to log messages in the parent process: [Issue #60](https://github.com/awslabs/amazon-kinesis-client/issues/60), that we're still looking at. For my own use I currently use my own...

I don't believe this is supported currently, but it is something we can look at adding support for in the future.