Simon Mo
Simon Mo
Yes. This will be worked on, added to the roadmap.
> enforce_eager must be set to True due to the dynamic graph created by the brute-force implementation. Can you discuss why is this the case? If possible i would really...
Done https://github.com/vllm-project/vllm/releases/tag/v0.6.1.post1
@br3no would love to get your feedback and review for this PR!
🫡 thank you for the contribution. merging
Contribution welcomed!
merging to unblock release
Question, typically our users rely on the cluster orchestrator to perform the restart, such as * Docker's restart flag * Kubernetes will redeploy the pod on crash This also gives...