BentoML
BentoML copied to clipboard
feature: support bentoml.depends.from_url("http://already.deployed-bento.com:3000")
Feature request
@bentoml.service(
traffic={"timeout": 600},
workers=8,
resources={"cpu": "1"}
)
class ControlNet:
# Pass the dependent Service class as an argument
# controlnet_service = bentoml.depends(SDXLControlNetService)
controlnet_service = bentoml.depends.from_url(
url= "http://already.deployed-bento.com:3000",
input = Annotated[torch.Tensor, Shape((1, 4)), DType("float32")],
output = Annotated[torch.Tensor, Shape((1, 4)), DType("float32")],
)
@bentoml.api
async def generate(self, image: PIL_Image, params: Params) -> PIL_Image:
Motivation
No response
Other
No response
Thanks, this will be included in 1.4, the next minor release
thx, this feature is implemented
https://docs.bentoml.com/en/latest/build-with-bentoml/distributed-services.html#depend-on-an-external-deployment