mlc-llm icon indicating copy to clipboard operation
mlc-llm copied to clipboard

[Model] Add use_qk_norm option for Cohere model

Open tlopex opened this issue 1 year ago • 3 comments

This pr updates use_qk_norm option for Cohere series models like Command-R-Plus.

tlopex avatar Sep 02 '24 17:09 tlopex