vespa icon indicating copy to clipboard operation
vespa copied to clipboard

Add support multiple outputs in FunctionEvaluator

Open jobergum opened this issue 2 years ago • 3 comments

A model might have several outputs.

Current API only supports one output per FunctionEvaluator.

FunctionEvaluator evaluator  = modelsEvaluator.evaluatorOf("reader", "output_0");
FunctionEvaluator evaluator1  = modelsEvaluator.evaluatorOf("reader", "output_1");
FunctionEvaluator evaluator2  = modelsEvaluator.evaluatorOf("reader", "output_2");

Not supporting several outputs in one evaluator is not optimal for models with multiple outputs as you need to invoke the model several times, once for each result. Something like

FunctionEvaluator evaluator  = modelsEvaluator.evaluatorOf("reader", "output_0","output_1", "output_2");

jobergum avatar Nov 08 '21 08:11 jobergum

Is this now complete with Vespa 8 @lesters ? If so, we should implement the reader using stateless evaluation for the dpr sample app.

jobergum avatar Sep 27 '22 08:09 jobergum

@jobergum Some work still remains. I'll get back to this ASAP.

lesters avatar Sep 28 '22 10:09 lesters

soon timed out

baldersheim avatar Sep 13 '23 20:09 baldersheim