euphoria icon indicating copy to clipboard operation
euphoria copied to clipboard

Local executor checkpointing

Open dmvk opened this issue 7 years ago • 1 comments

For streaming apps, we should implement simple checkpointing for LocalExecutor. Eg. when reading from kafka, we want to resume from last commited offset, so we can restart the app.

dmvk avatar Feb 12 '18 13:02 dmvk

Implementation note: we should periodically persist state to local disk and add parameter to continue processing from given checkpointId.

je-ik avatar Feb 12 '18 14:02 je-ik