BentoML icon indicating copy to clipboard operation
BentoML copied to clipboard

Published 20 hours ago • verified publisher icon bentoml

feature: BentoML Client as a separate package

Open judahrand opened this issue 2 years ago • 2 comments

Feature request

BentoML Client should exist as a separate Python package.

Motivation

It is a pretty hard no-go for my team to install the whole of bentoml into the Python environment which will be the client to our BentoML services. This is due to the huge number of unneeded dependencies including Starlette and Open Telemetry. It seems to me that this section of BentoML should really be a separate package?

Other

No response

judahrand avatar Aug 17 '23 07:08 judahrand

not currently on our high-priority list, but we will consider this as we have some plans for batch inference.

aarnphm avatar Aug 17 '23 08:08 aarnphm

not currently on our high-priority list, but we will consider this as we have some plans for batch inference.

This might actually end up being a blocking problem for us 😢

judahrand avatar Aug 17 '23 10:08 judahrand