Jiaxin Shan
Jiaxin Shan
move to v0.3.0 due to limited bandwidth
I will finish the code review by tomorrow. A little bit busy on some miscs
Overall code change looks good to me. However, we need some discussion on the model API abstraction. We should come up enough future features and take those insights into the...
StormService will be widely used in the latest inference architecture, and we don't plan to introduce new APIs at this point. StormService should be sufficient for current needs. Whether an...
After that, any feature relies on statistics won't work out of box and they have to append the stream options right? If that case, Let's update the docs as well....
@varungup90 the change looks good to me, feel free to merge it if there's no further change
@zhaotyer `x-kubernetes-validations` is a structural schema validation extension introduced in Kubernetes v1.23 as an alpha feature and graduated to beta in v1.25. What you can do for short term workaround...
/remove-lifecycle rotten
@ericmeadows > aren't you able to support multi-key auth by rolling your own nginx in front of this? technically, yes. key can be fully managed out of aibrix scope. user...
@vivekskrishna Hi, thanks for your feedback, there're two issues we can discuss here. 1. Even using RayClusterFleet, the communication is still optimal here. RDMA is being used by nccl and...