David Newman
David Newman
A non-const reference parameter, such as an Mat&, can only refer to an "lvalue" that is a named variable. You need to allocate the `frame.clone()` to a variable before you...
I looked into the test failures and they aren't related to my change, which is only changing a single log line.
@shrekris-anyscale you were correct, the tests were failing due to a mock object being returned for the get_address() call, instead of a string. I've added a default [string return for...
:heavy_plus_sign: 1
Unfortunately the fastapi bump has broken [Ray 2.9 compatibility](https://github.com/vllm-project/vllm/blob/530821d00cb2beeb8dc62f74f0e4e0003868dc93/requirements-cuda.txt#L5). ```bash $ pip install vllm==0.6.1.post2 'ray[serve]==2.9.3' ... snip... The conflict is caused by: vllm 0.6.1.post2 depends on fastapi>=0.114.1; python_version >= "3.9"...
I'm running into the same error with `2.42.0`.
The issue with pinning to a specific Ray version is that anyone with a long running cluster will not be able to upgrade vLLM services unless they upgrade the entire...