dockertest
dockertest copied to clipboard
Kafka example doesn't work
Preflight checklist
- [X] I could not find a solution in the existing issues, docs, nor discussions.
- [X] I agree to follow this project's Code of Conduct.
- [X] I have read and am following this repository's Contribution Guidelines.
- [ ] This issue affects my Ory Network project.
- [ ] I have joined the Ory Community Slack.
- [ ] I am signed up to the Ory Security Patch Newsletter.
Describe the bug
The Kafka example doesn't work and does not terminate containers.
Reproducing the bug
- Copy the Kafka example from the examples dir
- Run it
Relevant log output
2022/10/29 14:44:53 connected to 127.0.0.1:55032
2022/10/29 14:44:53 authentication failed: EOF
2022/10/29 14:44:54 connected to 127.0.0.1:55032
2022/10/29 14:44:54 authentication failed: EOF
2022/10/29 14:44:55 connected to 127.0.0.1:55032
2022/10/29 14:44:55 authenticated: id=109251388718055424, timeout=10000
2022/10/29 14:44:55 re-submitting `0` credentials after reconnect
%6|1667043896.618|FAIL|rdkafka#producer-1| [thrd:localhost:9093/bootstrap]: localhost:9093/bootstrap: Disconnected while requesting ApiVersion: might be caused by incorrect security.protocol configuration (connecting to a SSL listener?) or broker version is < 0.10 (see api.version.request) (after 1ms in state APIVERSION_QUERY)
%6|1667043896.803|FAIL|rdkafka#producer-1| [thrd:localhost:9093/bootstrap]: localhost:9093/bootstrap: Disconnected while requesting ApiVersion: might be caused by incorrect security.protocol configuration (connecting to a SSL listener?) or broker version is < 0.10 (see api.version.request) (after 1ms in state APIVERSION_QUERY, 1 identical error(s) suppressed)
%6|1667043933.044|FAIL|rdkafka#producer-1| [thrd:localhost:9093/bootstrap]: localhost:9093/bootstrap: Disconnected while requesting ApiVersion: might be caused by incorrect security.protocol configuration (connecting to a SSL listener?) or broker version is < 0.10 (see api.version.request) (after 2ms in state APIVERSION_QUERY, 6 identical error(s) suppressed)
Relevant configuration
No response
Version
latest
On which operating system are you observing this issue?
macOS
In which environment are you deploying?
Docker
Additional Context
I am running go1.19.2
on M1 mac with macOS Monterey
Faced the same issue today while running kafka tests with dockertest and using the same kafka/zookeeper configuration as in the mentioned example
Face the same issue
it's just faster/less-resource-intensive to use redpanda as a drop-in replacement for kafka in tests.
The issue still happens (in both Ubuntu and MacOS), any progress/hints/suggestions here? :beers: I assume this is not an issue with dockertest per se, but the configuration of zookeeper and/or the broker, and thus can be solved by kafka gurus most likely.