BentoML icon indicating copy to clipboard operation
BentoML copied to clipboard

feature: test bento bundle

Open asafalinadsg opened this issue 1 year ago • 0 comments

Feature request

Bentos are a great way to collaborate, as they are self-contained and can be converted to virtually anything - loaded in Python as used as runners, converted to docker images or converted to anything else through an automated process that fits your organization need. This makes Bentos a great interface between data scientists and engineers, where the data scientists builds the Bento and the engineers can take it from there to virtually anywhere.

The problem is that a data scientist does not have a straightforward way to test that his Bento is packaged correctly. For example, consider a case that a data scientist forgot to mention a Python dependency. If he uses bentoml serve, it will seem to him that everything works fine, as he probably runs it on his own environment. However, as soon as he move to a different environment, where the Python dependency will indeed be missed, then the serving will fail.

This feature proposes an interface for a Bento builder to test and make sure the Bento is correctly packaged. There is a draft PR open implementing this.

Motivation

Currently, there is no straight forward way for a Bento builder to validate that his Bento (the result of a bentoml build command) is bundled correctly. The bundling relays on the Bentofile.yaml file, which needs to be configured manually, and therefore is prone for manual mistakes.

Implementing this feature will give the Bento builder an easy way to test his Bento on his development machine, removing possible issues that might arise when moving to a different environment.

Other

No response

asafalinadsg avatar Sep 05 '22 13:09 asafalinadsg