kafka-connect-spooldir icon indicating copy to clipboard operation
kafka-connect-spooldir copied to clipboard

Could not parse '2001-01-01' to java.util.Date

Open sirishankar opened this issue 5 years ago • 0 comments

I get the following error (at the bottom) with dates (time and timestamp as well). Am I missing something here? appreciate your help. thx

configuration

name=testWithDates1
connector.class=com.github.jcustenborder.kafka.connect.spooldir.SpoolDirCsvSourceConnector
csv.first.row.as.header=true
finished.path=/var
tasks.max=1
halt.on.error=false
schema.generation.key.name=myKey
schema.generation.value.name=myValue
parser.timestamp.date.formats=[MM/dd/yyyy]
schema.generation.enabled=false
key.schema={"name":"dev.test.TestKey","type":"STRUCT","isOptional":true,"fieldSchemas":{"id":{"type":"INT32","isOptional":false}}}
csv.file.charset=UTF-8
input.file.pattern=.*csv
csv.separator.char=44
timestamp.mode=FILE_TIME
topic=sankar_test_topic_21
error.path=/tmp
input.path=/home
value.schema={"name":"dev.test.TestValue","type":"STRUCT","isOptional":true,"fieldSchemas":{"id":{"type":"INT32","isOptional":false},"name":{"type":"STRING","isOptional":false},"dob":{"name":"org.apache.kafka.connect.data.Date","type":"INT32","version":1,"isOptional":true},"active":{"type":"BOOLEAN","isOptional":true}}}

csv file content

id,name,dob,active
1,test,01/01/2001,true

error

org.apache.kafka.connect.errors.DataException: Exception thrown while parsing data for 'dob'. linenumber=2
        at com.github.jcustenborder.kafka.connect.spooldir.SpoolDirCsvSourceTask.process(SpoolDirCsvSourceTask.java:126)
        at com.github.jcustenborder.kafka.connect.spooldir.SpoolDirSourceTask.read(SpoolDirSourceTask.java:286)
        at com.github.jcustenborder.kafka.connect.spooldir.SpoolDirSourceTask.poll(SpoolDirSourceTask.java:165)
        at org.apache.kafka.connect.runtime.WorkerSourceTask.poll(WorkerSourceTask.java:244)
        at org.apache.kafka.connect.runtime.WorkerSourceTask.execute(WorkerSourceTask.java:220)
        at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:175)
        at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:219)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.kafka.connect.errors.DataException: Could not parse '01/01/2001' to 'Date'
        at com.github.jcustenborder.kafka.connect.utils.data.Parser.parseString(Parser.java:113)
        at com.github.jcustenborder.kafka.connect.spooldir.SpoolDirCsvSourceTask.process(SpoolDirCsvSourceTask.java:118)
        ... 11 more
Caused by: java.lang.IllegalStateException: Could not parse '01/01/2001' to java.util.Date
        at com.google.common.base.Preconditions.checkState(Preconditions.java:197)
        at com.github.jcustenborder.kafka.connect.utils.data.type.BaseDateTypeParser.parseString(BaseDateTypeParser.java:55)
        at com.github.jcustenborder.kafka.connect.utils.data.Parser.parseString(Parser.java:109)
        ... 12 more

sirishankar avatar Mar 19 '19 14:03 sirishankar