Yatai icon indicating copy to clipboard operation
Yatai copied to clipboard

Does yatai deployment require saving the model to the bentos model store?

Open xytsinghua opened this issue 1 year ago • 2 comments
trafficstars

In service.py, the pt model file is directly read through the custom runner without saving the model to the bentoml model store. As a result, yatai cannot be deployed normally because there is no model file. Is there any solution?

xytsinghua avatar Feb 23 '24 03:02 xytsinghua

Hi @xytsinghua - you can use the include field in bentofile.yaml to allow the Bento to include your model file. See https://docs.bentoml.com/en/latest/guides/build-options.html#include

parano avatar Feb 26 '24 20:02 parano

Hi @parano WX20240227-140749 The error screenshot is shown above. I followed your suggestion, but the model file is in the src directory, not in the models directory. yatai deployment still reporting an error that the model file cannot be found.

xytsinghua avatar Feb 28 '24 01:02 xytsinghua