FastChat icon indicating copy to clipboard operation
FastChat copied to clipboard

Published 20 hours ago • verified publisher icon lm-sys

upgrade xFasterTransformer support to latest version

Open a3213105 opened this issue 10 months ago • 0 comments

Why are these changes needed?

xFasterTransformer has upgraded to latest version and supported more models and parameters. So, we want to upgrade xFasterTransformer API to the newest.

Related issue number (if applicable)

Checks

  • [ * ] I've run format.sh to lint the changes in this PR.
  • [ * ] I've included any doc changes needed.
  • [ * ] I've made sure the relevant tests are passing (if applicable).

a3213105 avatar Apr 09 '24 03:04 a3213105