Yatai
Yatai copied to clipboard
how to deploy with cutom-runner
the company's project is using yolov5 and deep sort models. we did not store these two model in bentoml model store, but call them by self-defining a runner which inherit the bentoml.Runnable. it is ok to start by calling the command of bentoml serve. but cannot push and deploy in yatai for there is no mode stored and pushed. Could anyone inform how to store these models in the format of bentoml ? or bentoml can only work on single stored model and not on multi-model project?
Hi @johnwayne19860314 , two ways you can do that in BentoML:
- use
include
: https://docs.bentoml.com/en/latest/guides/build-options.html#include - save a custom model: https://docs.bentoml.com/en/latest/guides/model-store.html#save-a-model