Aaron Pham
Aaron Pham
bug: Http Server is not worked with Pytorch-Lightning without 'del sys.modules["prometheus_client"]'
No, it works perfectly fine for me. Can you send your `bentoml env -o bash`? also would be helpful if you can send the output of `bentoml serve --debug`?
bug: Http Server is not worked with Pytorch-Lightning without 'del sys.modules["prometheus_client"]'
Hey, is there any chances that your models doesn't contain a signature?
bug: Http Server is not worked with Pytorch-Lightning without 'del sys.modules["prometheus_client"]'
can you send the output of `cat $(bentoml models get model:tag -o path)/model.yaml`?
bug: Http Server is not worked with Pytorch-Lightning without 'del sys.modules["prometheus_client"]'
If you have a custom runnable, please check there aren't any bug there as well FYI For the yolov5 issue, please check if you have all required dependencies you can...
This is intended, as we want the build from bentoml to be atomic. I will probably transfer this to BentoML and we can track it there.
@sauyon you need to change the tests patch `requests` to `httpx`. Let's open a separately PR to fix the test?
we probably should note the side effect of doing this here - If there is a package/folder named grpc, it will override the default `grpc` import, which makes `serve-grpc` not...
Going to transfer this upstream to BentoML since it is a BentoML issue.
This would requires BentoML gRPC feature to support streaming, which it is not currently
Streaming is now supported via SSE. gRPC streaming will requires streaming support for gRPC on BentoML. I'm going to transfer this to BentoML for now since SSE should be sufficient...