vllm
vllm copied to clipboard
[Misc]: Cohere models are not working due to transformers library outdated?
Anything you want to discuss about vllm.
Got error
ValueError: The checkpoint you are trying to load has model type cohere
but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.