kafka-connect-elasticsearch icon indicating copy to clipboard operation
kafka-connect-elasticsearch copied to clipboard

Task threw an uncaught and unrecoverable exception : buildMapping, buildStruct....

Open EvKoh opened this issue 3 years ago • 0 comments

Hello, what is this error?

WorkerSinkTask{id=connector-1-3} Task threw an uncaught and unrecoverable exception"}
--
  | org.apache.kafka.connect.errors.ConnectException: Exiting WorkerSinkTask due to unrecoverable exception.
  | at org.apache.kafka.connect.runtime.WorkerSinkTask.deliverMessages(WorkerSinkTask.java:564)
  | at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:325)
  | at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:228)
  | at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:200)
  | at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:178)
  | at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:228)
  | at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  | at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  | at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  | at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  | at java.lang.Thread.run(Thread.java:750)
  | Caused by: java.lang.StackOverflowError
  | at com.fasterxml.jackson.core.json.UTF8JsonGenerator.writeString(UTF8JsonGenerator.java:503)
  | at com.fasterxml.jackson.core.JsonGenerator.writeStringField(JsonGenerator.java:2164)
  | at org.elasticsearch.xcontent.json.JsonXContentGenerator.writeStringField(JsonXContentGenerator.java:266)
  | at org.elasticsearch.xcontent.XContentBuilder.field(XContentBuilder.java:643)
  | at io.confluent.connect.elasticsearch.Mapping.addTextMapping(Mapping.java:112)
  | at io.confluent.connect.elasticsearch.Mapping.inferPrimitive(Mapping.java:167)
  | at io.confluent.connect.elasticsearch.Mapping.buildMapping(Mapping.java:102)
  | at io.confluent.connect.elasticsearch.Mapping.buildStruct(Mapping.java:147)
  | at io.confluent.connect.elasticsearch.Mapping.buildMapping(Mapping.java:99)
  | at io.confluent.connect.elasticsearch.Mapping.buildMapping(Mapping.java:93)
  | at io.confluent.connect.elasticsearch.Mapping.buildStruct(Mapping.java:147)
  | at io.confluent.connect.elasticsearch.Mapping.buildMapping(Mapping.java:99)
  | at io.confluent.connect.elasticsearch.Mapping.buildMapping(Mapping.java:93)
  | at io.confluent.connect.elasticsearch.Mapping.buildStruct(Mapping.java:147)
  | at io.confluent.connect.elasticsearch.Mapping.buildMapping(Mapping.java:99)
  | at io.confluent.connect.elasticsearch.Mapping.buildMapping(Mapping.java:93)
  | at io.confluent.connect.elasticsearch.Mapping.buildStruct(Mapping.java:147)
  | at io.confluent.connect.elasticsearch.Mapping.buildMapping(Mapping.java:99)
  | at io.confluent.connect.elasticsearch.Mapping.buildMapping(Mapping.java:93)
  | at io.confluent.connect.elasticsearch.Mapping.buildStruct(Mapping.java:147)
  | at io.confluent.connect.elasticsearch.Mapping.buildMapping(Mapping.java:99)
  | at io.confluent.connect.elasticsearch.Mapping.buildMapping(Mapping.java:93)
  
...1008 lines...

  | at io.confluent.connect.elasticsearch.Mapping.buildMapping(Mapping.java:99)
  | at io.confluent.connect.elasticsearch.Mapping.buildMapping(Mapping.java:93)
  | at io.confluent.connect.elasticsearch.Mapping.buildStruct(Mapping.java:147)
  | at io.confluent.connect.elasticsearch.Mapping.buildMapping(Mapping.java:99)
  | at io.confluent.connect.elasticsearch.Mapping.buildMapping(Mapping.java:93)
  | at io.confluent.connect.elasticsearch.Mapping.buildStruct(Mapping.java:147)
  | at io.confluent.connect.elasticsearch.Mapping.buildMapping(Mapping.java:99)
  | at io.confluent.connect.elasticsearch.Mapping.buildMapping(Mapping.java:93)
  | at io.confluent.connect.elasticsearch.Mapping.buildStruct(Mapping.java:147)
  | at io.confluent.connect.elasticsearch.Mapping.buildMapping(Mapping.java:99)
  | at io.confluent.connect.elasticsearch.Mapping.buildMapping(Mapping.java:93)

My connector :

{
  "name": "connector-1",
  "config": {
    "connector.class": "io.confluent.connect.elasticsearch.ElasticsearchSinkConnector",
    "type.name": "_doc",
    "key.converter.schema.registry.ssl.keystore.location": "/etc/kafka-connect/jks/***.jks",
    "consumer.override.group.id": "***",
    "errors.log.include.messages": "true",
    "connection.password": "***",
    "tasks.max": "5",
    "value.converter.schema.registry.ssl.keystore.password": "***",
    "key.ignore": "true",
    "value.converter.schema.registry.ssl.truststore.password": "***",
    "errors.deadletterqueue.context.headers.enable": "true",
    "key.converter.schema.registry.ssl.truststore.location": "/etc/kafka-connect/jks/***.jks",
    "value.converter.schema.registry.ssl.keystore.location": "/etc/kafka-connect/jks/***.jks",
    "errors.deadletterqueue.topic.replication.factor": "2",
    "value.converter": "io.confluent.connect.avro.AvroConverter",
    "errors.log.enable": "true",
    "key.converter": "org.apache.kafka.connect.storage.StringConverter",
    "key.converter.schema.registry.ssl.keystore.password": "***",
    "value.converter.schema.registry.ssl.truststore.location": "/etc/kafka-connect/jks/***.jks",
    "topics": "***,***,***",
    "connection.username": "***",
    "schema.ignore": "false",
    "key.converter.schema.registry.ssl.truststore.password": "***",
    "value.converter.schema.registry.url": "https://***",
    "key.converter.schemas.enable": "true",
    "errors.deadletterqueue.topic.name": "***DLQ***",
    "name": "connector-1",
    "value.converter.schemas.enable": "true",
    "errors.tolerance": "all",
    "connection.url": "http://***:9200",
    "key.converter.schema.registry.url": "https://***"
  },
  "tasks": [
    {
      "connector": "connector-1",
      "task": 0
    },
    {
      "connector": "connector-1",
      "task": 1
    },
    {
      "connector": "connector-1",
      "task": 2
    },
    {
      "connector": "connector-1",
      "task": 3
    },
    {
      "connector": "connector-1",
      "task": 4
    }
  ],
  "type": "sink"
}

Thank you

EvKoh avatar Oct 05 '22 15:10 EvKoh