vllm icon indicating copy to clipboard operation
vllm copied to clipboard

[Misc]: Cohere models are not working due to transformers library outdated?

Open Playerrrrr opened this issue 11 months ago • 3 comments

Anything you want to discuss about vllm.

Got error

ValueError: The checkpoint you are trying to load has model type cohere but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.

Playerrrrr avatar Mar 29 '24 08:03 Playerrrrr