kafka-connect-cosmosdb
kafka-connect-cosmosdb copied to clipboard
Kafka connector not supporting unix timestamp in milliseconds
We are trying to insert the following JSON payload data in cosmos db with Kafka connector with a bunch of other fields we are getting the following error from the connector.
ERROR WorkerSourceTask{id=cosmosdb-source-connector-1} Task threw an uncaught and unrecoverable exception (org.apache.ka ││ org.apache.kafka.connect.errors.DataException: Invalid value: null used for required field: "create_time", schema type: INT64
Sample data:
{ "first_name" : "John", "last_name" : "Doe" "created_time": 1625565568878, "update_time": 1625565568878 }
If we try to remove the last three digits from the timestamps then the connector works. ( For example changing 1625565568878 to 1625565568 works. Please assist.