kafka-connect-cosmosdb icon indicating copy to clipboard operation
kafka-connect-cosmosdb copied to clipboard

Kafka connector not supporting unix timestamp in milliseconds

Open preritmohan opened this issue 3 years ago • 0 comments

We are trying to insert the following JSON payload data in cosmos db with Kafka connector with a bunch of other fields we are getting the following error from the connector.

ERROR WorkerSourceTask{id=cosmosdb-source-connector-1} Task threw an uncaught and unrecoverable exception (org.apache.ka ││ org.apache.kafka.connect.errors.DataException: Invalid value: null used for required field: "create_time", schema type: INT64

Sample data:

{ "first_name" : "John", "last_name" : "Doe" "created_time": 1625565568878, "update_time": 1625565568878 }

If we try to remove the last three digits from the timestamps then the connector works. ( For example changing 1625565568878 to 1625565568 works. Please assist.

preritmohan avatar Jul 23 '21 14:07 preritmohan