deepforge icon indicating copy to clipboard operation
deepforge copied to clipboard

Operations should be batched when not parallelizable

Open brollb opened this issue 8 years ago • 1 comments

To reduce data transmission across the network, operations in executing pipelines should be batched

brollb avatar May 27 '16 13:05 brollb

It is actually not clear that this is how it should behave. This will result in not saving the intermediate data between operations (making it so you can't necessarily restart just a single job).

However, if we are not in debug mode, then this might make sense as the actual operations won't be edited and restarted (as they are snapshots and cannot be edited).

brollb avatar Mar 23 '17 21:03 brollb