datapusher-plus icon indicating copy to clipboard operation
datapusher-plus copied to clipboard

Recoverable jobs

Open jqnatividad opened this issue 2 years ago • 0 comments

For an existing resource, when a job fails after it has already been deleted from the datastore, there is no easy way to recover.

To avoid this, DP+ should:

  • do a "soft-delete" of the table (perhaps, by temporarily renaming it?)
  • do the DP+ job as usual
  • if the job is successful, drop the "soft-deleted" table. If the job failed, restore the old table

jqnatividad avatar May 04 '22 23:05 jqnatividad