Yatai icon indicating copy to clipboard operation
Yatai copied to clipboard

how to deploy with cutom-runner

Open johnwayne19860314 opened this issue 1 year ago • 1 comments

the company's project is using yolov5 and deep sort models. we did not store these two model in bentoml model store, but call them by self-defining a runner which inherit the bentoml.Runnable. it is ok to start by calling the command of bentoml serve. but cannot push and deploy in yatai for there is no mode stored and pushed. Could anyone inform how to store these models in the format of bentoml ? or bentoml can only work on single stored model and not on multi-model project?

johnwayne19860314 avatar Feb 23 '24 03:02 johnwayne19860314

Hi @johnwayne19860314 , two ways you can do that in BentoML:

  • use include: https://docs.bentoml.com/en/latest/guides/build-options.html#include
  • save a custom model: https://docs.bentoml.com/en/latest/guides/model-store.html#save-a-model

parano avatar Feb 26 '24 20:02 parano