FastChat icon indicating copy to clipboard operation
FastChat copied to clipboard

Fix #3501 (VLLM): TypeError: top_k must be an integer, got float

Open surak opened this issue 1 year ago • 0 comments
trafficstars

VLLM needs top_j to be int, not float

Why are these changes needed?

For VLLM to work again

Related issue number (if applicable)

Closes #3501

Checks

  • [x] I've run format.sh to lint the changes in this PR.
  • [x] I've included any doc changes needed.
  • [ x I've made sure the relevant tests are passing (if applicable).

surak avatar Sep 23 '24 17:09 surak