Danilo Palumbo

Adding support for Cohere LLM

Choose a better separator for startCode and endCode

1

HI, I'm working on implementing Cohere LLM, and the separator used for startCode and endCode ( and ) doesn't work: I'm testing with different characters: 1. -_ 2. __ 3....

Refactor code for Cohere LLM (Need to improve it)

3

We actually don't have a response, so we should fix the response

Got this error with pip (`pip install vllm`): ``` error: subprocess-exited-with-error × Getting requirements to build wheel did not run successfully. │ exit code: 1 ╰─> See above for output....