superduper icon indicating copy to clipboard operation
superduper copied to clipboard

Optimize model writing and loading during prediction

Open blythed opened this issue 6 months ago • 0 comments

We should have separate processes writing model outputs, while other processes are loading data and predicting. This is particularly obvious when the inputs and outputs are large (order of magnitude of work in I/O comparable to prediction).

blythed avatar Aug 02 '24 10:08 blythed