Frost Ming
Frost Ming
Sounds good, it was actually in the original plan for this feature. PR welcome.
I can't reproduce using the latest version, here is the testing code: ```python import asyncio import bentoml import fastapi app = fastapi.FastAPI() @app.post("/greet") async def greet(): await asyncio.sleep(120) return "hello...
> After I commented out this line, the issue is gone. The `TimeoutMiddleware` did not read the environment variable `timeout`, correct? Is there anyway to control this? When you comment...
Not all providers support other output formats, for those that don't support, we need a conversion layer. Are you willing to contribute?
```python @bentoml.service(resources={"gpu": 4}) class MyService: ... ``` And it will inject `CUDA_VISIBLE_DEVICES=0,1,2,3` into the environment
What automation do you mean, that is all it does and it depends on how the framework respects the env var.
Redirect to #2633
It is a bit disruptive for a non-default option. You should know what it means when you change the config.
Traceback 不完整，截掉了关键信息
这个项目本质上是「Hack 小爱 In a Hard Way」如果你有自己的硬件，那完全可以脱离小爱，自己用扬声器、收音器和一个小型服务器就能做出一个REPL架构的东西，还自由，还好用。但那样就不是xiaogpt了。