Cindy Zhang

Results 14 comments of Cindy Zhang

[serve][docs] Document lightweight config updates

> Made some minor nits and suggestions. Thanks @dmatrix, addressed!

[serve] separate metrics code in router out into a metrics manager

> @zcin you have a merge conflict @edoakes Fixed!

[serve] separate metrics code in router out into a metrics manager

@edoakes Tests are passing!

Release test serve_autoscaling_multi_deployment.aws failed

@anyscalesam I took a look at this and it seems to be failing for some obscure reason. Will take a bit more time to look into it, but may leave...

Release test serve_autoscaling_multi_deployment.aws failed

This has been removed from our release tests and replaced with `serve_autoscaling_load_test`

[serve] Add initial health check before marking a replica as RUNNING

Windows tests unrelated.

[serve] Add initial health check before marking a replica as RUNNING

@edoakes @sihanwang41 Addressed comments, PTAL!

[Jobs] Track real job process

> Looks good! Does the new test fail without the change from this PR? (If not, we should have a test like that) Yup, the new `test_stop_job_timeout` fails before this...

[Serve] [Serve-autoscaler] Change target_num_ongoing_requests_per_replica to positive float

Please lmk if anyone thinks there are other unit tests that I should update!

[serve][deploy refactor][3/X] Move deployment state manager into application state manager

@edoakes Have yet to add any new tests, but ready for first round of review!