kinesis-python icon indicating copy to clipboard operation
kinesis-python copied to clipboard

Use of offpsring eventually leads to too many open files if there are closed shards

Open jeffglover opened this issue 6 years ago • 0 comments

While doing some testing of kinesis-python I was evaluating how well it handles live resharding. As old shards remained kinesis-python would spin up a ShardReader and shut it down for each inactive shard. Offspring keeps track of these instances only to cleanup on exit, but they build up overtime and eventually resulting in [Errno 24] Too many open files

Offspring looks dead, but I submitted a pull request that would fix it. https://github.com/borgstrom/offspring/pull/3

jeffglover avatar Oct 22 '19 14:10 jeffglover