[FT] Is it possible to save the predictions to prevent rerunning expensive inference

[JoelNiklaus]

Issue encountered

When evaluating large models, significant costs and delays can occur for inference, especially on larger datasets. Possibly I want to re-evaluate my predictions using different metrics.

Solution/Feature

I want the predictions to be saved in an inspectable cache which can be used when the evaluation is run again.