FastChat
FastChat copied to clipboard
Fix #3501 (VLLM): TypeError: top_k must be an integer, got float
trafficstars
VLLM needs top_j to be int, not float
Why are these changes needed?
For VLLM to work again
Related issue number (if applicable)
Closes #3501
Checks
- [x] I've run
format.shto lint the changes in this PR. - [x] I've included any doc changes needed.
- [ x I've made sure the relevant tests are passing (if applicable).