BentoML icon indicating copy to clipboard operation
BentoML copied to clipboard

feature: support bentoml.depends.from_url("http://already.deployed-bento.com:3000")

Open KimSoungRyoul opened this issue 1 year ago • 1 comments

Feature request


@bentoml.service(
    traffic={"timeout": 600},
    workers=8,
resources={"cpu": "1"}
)
class ControlNet:
    # Pass the dependent Service class as an argument
    # controlnet_service = bentoml.depends(SDXLControlNetService)
    controlnet_service = bentoml.depends.from_url(
       url= "http://already.deployed-bento.com:3000",
       input =  Annotated[torch.Tensor, Shape((1, 4)), DType("float32")],
       output =  Annotated[torch.Tensor, Shape((1, 4)), DType("float32")],
    )  

    @bentoml.api
    async def generate(self, image: PIL_Image, params: Params) -> PIL_Image:


Motivation

No response

Other

No response

KimSoungRyoul avatar May 19 '24 11:05 KimSoungRyoul

Thanks, this will be included in 1.4, the next minor release

frostming avatar Sep 11 '24 04:09 frostming

thx, this feature is implemented

https://docs.bentoml.com/en/latest/build-with-bentoml/distributed-services.html#depend-on-an-external-deployment

스크린샷 2024-12-22 오전 10 40 52

KimSoungRyoul avatar Dec 22 '24 01:12 KimSoungRyoul