systems icon indicating copy to clipboard operation
systems copied to clipboard

Published 20 hours ago • verified publisher icon NVIDIA-Merlin

Adjust the operators so they handle batched requests

Open karlhigley opened this issue 2 years ago • 0 comments

Operators:

  • [ ] Feast
  • [ ] Tensorflow
  • [ ] Faiss
  • [ ] ...

Open Questions:

  • [ ] How to use async in TritonPythonModel and OperatorRunner (execute becomes async, does transform?)

karlhigley avatar Mar 02 '22 17:03 karlhigley