FastChat icon indicating copy to clipboard operation
FastChat copied to clipboard

Published 20 hours ago • verified publisher icon lm-sys

fix error and support Phi-3 models

Open renning22 opened this issue 1 year ago • 1 comments
trafficstars

Why are these changes needed?

Model worker (also vllm_worker) has error loading Phi-3 models "microsoft/Phi-3-mini-128k-instruct" etc.. Screenshot from 2024-05-07 00-58-23

Checks

  • [x] I've run format.sh to lint the changes in this PR.
  • [x] I've included any doc changes needed.
  • [x] I've made sure the relevant tests are passing (if applicable).

renning22 avatar May 07 '24 21:05 renning22

@merrymercy @Ying1123 PTAL, thanks~

renning22 avatar May 08 '24 05:05 renning22