daniel-salib
daniel-salib
@youngkent handling exceptions on streaming requests now - PTAL
implemented @youngkent 's latest suggestions also re-ran the benchmark and updated the PR comment to ensure no regression
@simon-mo rebased and the precommit is passing now
@simon-mo I see some failures in the entrypoints test but they seem unrelated to the PR: I think we're good to merge but LMK if this is an issue. Thanks!...
ah I found the issue, adding the extra unit test to test_metrics messed up the expected metric numbers in metric counts because the tests run on the same server instance....