kafka-connect-storage-cloud icon indicating copy to clipboard operation
kafka-connect-storage-cloud copied to clipboard

Cannot build kafka-connect-s3: Could not find artifact io.confluent:licenses:jar and others

Open grantatspothero opened this issue 4 years ago • 4 comments

Hi there.

I followed the instructions here: https://github.com/confluentinc/kafka-connect-storage-common/wiki/FAQ and built the other repos and installed the necessary jars in order to get this project to build.

After doing that, I still am getting the following missing dependencies:

[ERROR] Failed to execute goal on project kafka-connect-s3: Could not resolve dependencies for project io.confluent:kafka-connect-s3:jar:10.1.0-SNAPSHOT: The following artifacts could not be resolved: io.confluent:connect-licensing-extensions:jar:0.5.2, io.confluent:connect-formatters-json:jar:0.2.2, io.confluent.testcontainers:squid-proxy:jar:1.0.1: Could not find artifact io.confluent:connect-licensing-extensions:jar:0.5.2 in confluent (http://packages.confluent.io/maven/) -> [Help 1]
[ERROR]

By manually looking at the confluent maven repo, none of these artifacts exist: http://packages.confluent.io/maven/io/confluent/

I found this old issue which suggests the missing licensing jar can be fixed by commenting out the licensing profile/dependency since the licensing jar is not published publically: https://github.com/confluentinc/kafka-connect-storage-cloud/issues/24

But when I do that, the integration tests break because they import things from the licensing jar, so I cannot just comment out the licensing dependency without breaking the tests: https://github.com/confluentinc/kafka-connect-storage-cloud/blob/master/kafka-connect-s3/src/test/java/io/confluent/connect/s3/integration/S3SinkConnectorIT.java#L22-L23

Additionally, I cannot begin to find where the other dependencies should be built from if they are even available at all:

io.confluent:connect-formatters-json:jar:0.2.2, io.confluent.testcontainers:squid-proxy:jar:1.0.1

Any help would be appreciated, has been a struggle getting this to build.

grantatspothero avatar Nov 17 '20 23:11 grantatspothero

Thanks for posting @grantatspothero ! The addition of ITs is very recent. We should fix this and not depend on non publicly available packages. cc @dosvath

kkonstantine avatar Nov 18 '20 00:11 kkonstantine

@grantatspothero Our fix https://github.com/confluentinc/kafka-connect-storage-cloud/pull/377 is out and will be merged ASAP.

dosvath avatar Nov 18 '20 15:11 dosvath

Thanks for the fast turnaround! I will try building that branch 👍

grantatspothero avatar Nov 18 '20 16:11 grantatspothero

This can be closed btw, #377 fixed the issue thanks!

grantatspothero avatar Jan 06 '21 20:01 grantatspothero