kafka-connect-jdbc icon indicating copy to clipboard operation
kafka-connect-jdbc copied to clipboard

JDBC Source Connector connection.url error

Open dipdeb opened this issue 2 years ago • 8 comments

Hi I have installed the confluent local version - 7.1.1. After installing the kafka-connect-jdbc getting this error An unexpected error occurred: org.apache.kafka.common.config.ConfigException: Missing required configuration "connection.url" which has no default value. on clicking the JdbcSourceConnector tile on the control center.

How to solve this problem?

dipdeb avatar May 31 '22 08:05 dipdeb

According to the error, you didn't supply the listed value, which is required.

I'd recommend using the Connect rest api directly rather than control center to better diagnose the problem

OneCricketeer avatar Jun 01 '22 03:06 OneCricketeer

@OneCricketeer thanks for the idea. It's working now. The problem is in the latest version of kafka-connect-jdbc (10.5.0). I had installed kafka-connect-jdbc couple months back in another machine and it is working, so I checked the version of jdbc connector in the old machine, using curl localhost:8083/connector-plugins | jq and tried installing the same version in the new machine instead of using "latest" in confluent-hub install --no-prompt confluentinc/kafka-connect-jdbc:10.3.3

dipdeb avatar Jun 01 '22 07:06 dipdeb

Glad to hear it. Feel free to close the issue

OneCricketeer avatar Jun 03 '22 01:06 OneCricketeer

I see the same issue and the problem is that when you select it in the Control Center 'Add Connector' web gui, the validation happens on page load, exception occurs and the usual config screen is unable to display .... image

miramar-labs avatar Jul 21 '22 04:07 miramar-labs

exception occurs and the usual config screen is unable to display

But you still have the ability to add the url under Additional Properties.

This issue itself is not with the JDBC connector. It should be brought up elsewhere for Control Center.

OneCricketeer avatar Jul 21 '22 05:07 OneCricketeer

But you still have the ability to add the url under Additional Properties.

but even if you do that, you've then lost all the other properties that need to be set ... the page doesn't 'reload' ...

seems to me these properties need to have default values specified in order for the UI to work .... (it's not just connection.url either) .. or maybe the UI should be validating on submit instead of on load .. happy to submit an issue in the UI repo if you can tell me where that is.

miramar-labs avatar Jul 21 '22 05:07 miramar-labs

Any update on this issue. I'm see the same problem on CP 7.2.1 control center.
Version 10.4.x and above are throwing this error. An unexpected error occurred: org.apache.kafka.common.config.ConfigException: Missing required configuration "connection.url" which has no default value.

bjosloff avatar Aug 04 '22 17:08 bjosloff

while you wait for a resolution, a workaround is to toss the web GUI altogether and use scripts/REST calls to manage your connectors - see here

miramar-labs avatar Aug 04 '22 18:08 miramar-labs

Same issue here, with a variety of different kafka connect UI's (akhq, kafka-ui etc...) - as well as failures provisioning via api port 8083 directly. 10.3.3 is the only version this works on, all versions since have this issue.

mikementzmaersk avatar Oct 07 '22 07:10 mikementzmaersk