kafka-connect-fs icon indicating copy to clipboard operation
kafka-connect-fs copied to clipboard

Published 20 hours ago • verified publisher icon mmolimar

Same file not processed

Open fabricebaranski opened this issue 3 years ago • 3 comments

When a file is processed, imagine file1.csv, I could not have the same file (if I copy it in the directory) processed again. Is it normal?

fabricebaranski avatar Oct 31 '21 12:10 fabricebaranski

If this file is exactly the same, this represents that the offsets were already sent to Kafka to avoid process the same thing over and over again and, consequently, it won't be process again. In case you add some lines to this file, the new lines will be processed in subsequent executions.

mmolimar avatar Nov 02 '21 17:11 mmolimar

Thanks for your answer. Is it possible to reset everything?

fabricebaranski avatar Nov 04 '21 12:11 fabricebaranski

What do you mean by "reset everything"?

mmolimar avatar Nov 04 '21 15:11 mmolimar