Alex Bromson comments

Repositories
Issues
Comments

Results 2 comments of


                                            Alex Bromson

Issue: Update VLLM to Version .5.0++, and a few suggestions

Guys, do we know anything about the approximate time frame for the update? So that you can somehow plan the update of the models in the roadmap. Thanks

[Bug]: vllm 0.6.3 generates incomplete/repeated answers for long length (over 8k) input

> > As mentioned in this issue #9417, it works with `--enforce-eager` > > I'm having the same issue. Running with `--enforce-eager` fixes this issue for now. Awesome! It's work...