kafka-connect-reddit
kafka-connect-reddit copied to clipboard
C0urante
Kafka Connector for Reddit
Can you do a "docker stats" and have a look at the load? I am getting 200% CPU load at the start and 100% after a few minutes. This is...
Bumps [junit](https://github.com/junit-team/junit4) from 4.12 to 4.13.1. Release notes Sourced from junit's releases. JUnit 4.13.1 Please refer to the release notes for details. JUnit 4.13 Please refer to the release notes...
![dependabot[bot] avatar](https://avatars.githubusercontent.com/in/29110?v=4 "dependabot[bot] avatar"){kind=avatar}
This adds in support so that you can stand up this connector and have it up and working from a local build. Also, this gives support to customize the subreddit,...
* Accept credentials in the configuration * Support credentials in application.
Make the docker container publically available.
Integration tests should be added to ensure that the connector can consume from Reddit. If possible, test logic should also be added to ensure that the data produced is well-formed...
Unit tests should be added for any classes with non-trivial functionality. This includes the `RedditSourceTask` class and most if not all classes in the `com.github.c0urante.kafka.connect.reddit.stream` package.
The IDs reddit associates with its threads and comments are monotonically increasing base 36 numbers; these should be used to store offset information instead of timestamp since two posts/comments can...