Support resumability of tasks

[alon710]

When a specific task reaches max retries, the task is forever gone. I want to save failed tasks and their state in order to re-execute them when I fix the bug that causes the task to fail.

My main goal is to make sure that all of my tasks won't get lost and will be executed eventually.

Thanks, @wavenator