kafka-connect-storage-cloud
kafka-connect-storage-cloud copied to clipboard
Cannot build kafka-connect-s3: Could not find artifact io.confluent:licenses:jar and others
Hi there.
I followed the instructions here: https://github.com/confluentinc/kafka-connect-storage-common/wiki/FAQ and built the other repos and installed the necessary jars in order to get this project to build.
After doing that, I still am getting the following missing dependencies:
[ERROR] Failed to execute goal on project kafka-connect-s3: Could not resolve dependencies for project io.confluent:kafka-connect-s3:jar:10.1.0-SNAPSHOT: The following artifacts could not be resolved: io.confluent:connect-licensing-extensions:jar:0.5.2, io.confluent:connect-formatters-json:jar:0.2.2, io.confluent.testcontainers:squid-proxy:jar:1.0.1: Could not find artifact io.confluent:connect-licensing-extensions:jar:0.5.2 in confluent (http://packages.confluent.io/maven/) -> [Help 1]
[ERROR]
By manually looking at the confluent maven repo, none of these artifacts exist: http://packages.confluent.io/maven/io/confluent/
I found this old issue which suggests the missing licensing jar can be fixed by commenting out the licensing profile/dependency since the licensing jar is not published publically: https://github.com/confluentinc/kafka-connect-storage-cloud/issues/24
But when I do that, the integration tests break because they import things from the licensing jar, so I cannot just comment out the licensing dependency without breaking the tests: https://github.com/confluentinc/kafka-connect-storage-cloud/blob/master/kafka-connect-s3/src/test/java/io/confluent/connect/s3/integration/S3SinkConnectorIT.java#L22-L23
Additionally, I cannot begin to find where the other dependencies should be built from if they are even available at all:
io.confluent:connect-formatters-json:jar:0.2.2, io.confluent.testcontainers:squid-proxy:jar:1.0.1
Any help would be appreciated, has been a struggle getting this to build.
Thanks for posting @grantatspothero ! The addition of ITs is very recent. We should fix this and not depend on non publicly available packages. cc @dosvath
@grantatspothero Our fix https://github.com/confluentinc/kafka-connect-storage-cloud/pull/377 is out and will be merged ASAP.
Thanks for the fast turnaround! I will try building that branch 👍
This can be closed btw, #377 fixed the issue thanks!