zero

Hi, @cliveseldon , our team also has interest on this feature, so is there any new release timeline targeted for V2 APIS ?

Hi, @sriumcp is there any plan to go on this issue ? I found no message related to this feature in iter8 v0.8 roadmap and this feature will be very...

Ensemble config > name: "ensemble_model" platform: "ensemble" max_batch_size: 0 input [ { name: "ABSMModelMergedInput" data_type: TYPE_FP32 dims: [-1,100,39] # Variable batch size } ] output [ { name: "dense_11" data_type:...

ONNX Model Config > name: "ABSMMODEL_V2" backend: "onnxruntime" max_batch_size : 0 input [ { name: "ABSMModelMergedInput" data_type: TYPE_FP32 dims: [-1,100,39] # Variable batch size } ] output [ { name:...

performance > (base) root@aiml-jenkins-worker:/home/xzhou4# env file=test-data.json wrk/wrk -t1 -c1 -d30s --latency -s benchmark.lua http://localhost:8000/v2/models/ABSMMODEL_V3/infer Running 5m test @ http://localhost:8000/v2/models/ABSMMODEL_V3/infer 1 threads and 1 connections ^C Thread Stats Avg Stdev Max...

ensemble_model perf > (base) root@aiml-jenkins-worker:/home/xzhou4# env file=test-data.json wrk/wrk -t1 -c1 -d30s --latency -s benchmark.lua http://localhost:8000/v2/models/ensemble_model_1/infer Running 5m test @ http://localhost:8000/v2/models/ensemble_model_1/infer 1 threads and 1 connections ^C Thread Stats Avg Stdev...