Gene Der Su issues

Results 5 issues of


                                            Gene Der Su

[serve] Fix utils import in serve deploy

## Why are these changes needed? Re: https://github.com/anyscale/product/issues/20746#issuecomment-1555027363 Currently we have issue to deploy applications containing `utils` modules and this is still the case with the latest master. After some...

[Serve] Add ray serve request timeout to config

## Why are these changes needed? Currently the only way to config the http request timeout is through setting up `RAY_SERVE_REQUEST_PROCESSING_TIMEOUT_S` (or yet to deprecated `SERVE_REQUEST_PROCESSING_TIMEOUT_S`) environment variables. This PR...

[serve] add early return when there are still in progress http health check

## Why are these changes needed? Currently there is a missing early return when there is a in progress http health check. Due to the default health check period (10s)...

[Serve] http proxy timeout are not getting triggered

### What happened + What you expected to happen When the health check hangs, longer than the default timeout of 30s, http proxy should timed out and eventually fails the...

bug

serve

[Serve] design and implement transparent HTTP2 proxy

Currently we are using [uvicorn](https://www.uvicorn.org/) to implement http proxy. We need to find an HTTP2 compatible server to to replace it and implement http and grpc proxy on top of...