Edward Oakes
Edward Oakes
@ShenJiahuan thanks for filing the issue! We're aware of the proxy as the bottleneck for each node. The reason for this design decision is because the proxy includes quite a...
> > I meet this issue in my task too, and I re-run the script you provide, the throughput is approximately 220 QPS，can you tell me the misconfiguration adjust to...
> @edoakes Hi! I would like to know what factors might affect the performance level of ProxyActor, such as the configuration of the server or the complexity of the application....
> Any updates? I go with ray serve but faced my model infers 0.5s but a `__call__` func takes 1s so it is x2. I saw @edoakes mentioned that they...
There's a merge conflict here
pushed a commit to fix linter
> @akshay-anyscale, @edoakes i managed to create an environment for the test to run but it fails for some other reasons https://buildkite.com/ray-project/microcheck/builds/237#018f8c35-e5a1-443d-8cf9-bbb481af6c1e/177-2429; if this makes sense feel free to change...
@zcin I'd still like to add more unit tests but this is ready for review
@zcin you have a merge conflict