FastChat icon indicating copy to clipboard operation
FastChat copied to clipboard

Update model_adapter.py

Open KnightLancelot opened this issue 1 year ago • 0 comments
trafficstars

    # Due to the removal of the "fp16" attribute from Qwen2's config, the following conditional statement needs to be added if a Qwen2 model is to be used:
    if( "qwen2" not in str(config.__class__) ): 
        self.float_set(config, "fp16")

Why are these changes needed?

Related issue number (if applicable)

Checks

  • [ ] I've run format.sh to lint the changes in this PR.
  • [ ] I've included any doc changes needed.
  • [ ] I've made sure the relevant tests are passing (if applicable).

KnightLancelot avatar Jun 12 '24 03:06 KnightLancelot