kafka-connect-solr icon indicating copy to clipboard operation
kafka-connect-solr copied to clipboard

Cannot start kafka-connect process due to "java.lang.NoClassDefFoundError: org/apache/commons/logging/LogFactory"

Open ttrading opened this issue 3 years ago • 8 comments

I am running this on CentOS8. Kafka, zookeeper, Kafka-Connect and Solr are running on the same server.

Following is the terminal output: execution error.txt

My plugin path defined in /usr/local/kafka-connect/connect-standalone.properties is: plugin.path=/usr/local/kafka-connect,/usr/local/kafka/libs,/usr/share/java

Here is all the jar files after compilation:

[root@solr lib]# pwd /usr/local/kafka-connect/kafka-connect-solr/jcustenborder-kafka-connect-solr-0.1-SNAPSHOT/lib [root@solr lib]# ls checker-qual-2.10.0.jar httpclient-4.5.6.jar jetty-io-9.4.19.v20190610.jar commons-io-2.5.jar httpcore-4.4.10.jar jetty-util-9.4.19.v20190610.jar commons-math3-3.6.1.jar httpmime-4.5.6.jar jsr305-3.0.2.jar connect-utils-0.4.164.jar j2objc-annotations-1.3.jar kafka-connect-solr-0.1-SNAPSHOT.jar error_prone_annotations-2.3.4.jar jackson-annotations-2.11.2.jar listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar failureaccess-1.0.1.jar jackson-core-2.11.2.jar reflections-0.9.11.jar freemarker-2.3.28.jar jackson-databind-2.11.2.jar solr-solrj-8.2.0.jar guava-28.2-jre.jar javassist-3.21.0-GA.jar stax2-api-3.1.4.jar http2-client-9.4.19.v20190610.jar jetty-alpn-client-9.4.19.v20190610.jar woodstox-core-asl-4.4.1.jar http2-common-9.4.19.v20190610.jar jetty-alpn-java-client-9.4.19.v20190610.jar zookeeper-3.5.5.jar http2-hpack-9.4.19.v20190610.jar jetty-client-9.4.19.v20190610.jar zookeeper-jute-3.5.5.jar http2-http-client-transport-9.4.19.v20190610.jar jetty-http-9.4.19.v20190610.jar [root@solr lib]#

It is a standalone system. I built solr for testing purposes. Here is my properties file:

[root@solr etc]# cat httpsolr.properties

name=connsolr topics=conn tasks.max=1 connector.class=com.github.jcustenborder.kafka.connect.solr.HttpSolrSinkConnector solr.url=http://solr:8983/solr/lsl_conn solr.topic=lsl_conn solr.core.name=lsl_conn transforms=prune,key,cast transforms.prune.type=org.apache.kafka.connect.transforms.ReplaceField$Value transforms.prune.whitelist=CreatedAt,Id,Text,Source,Truncated transforms.key.type=org.apache.kafka.connect.transforms.ExtractField$Key transforms.key.field=Id transforms.cast.type=org.apache.kafka.connect.transforms.Cast$Key transforms.cast.spec=string [root@solr etc]# ^C [root@solr etc]# pwd /usr/local/kafka-connect/kafka-connect-solr/jcustenborder-kafka-connect-solr-0.1-SNAPSHOT/etc

Am I missing something here? Do I need all the attributes for my setup? It is not a cluster. Do I need these "transforms" or "solr.topic"?

ttrading avatar Sep 18 '20 05:09 ttrading