Support Cohere as Embeddings Provider

[maxbrunet]

Validations

• [X] I believe this is a way to improve. I'll try to join the Continue Discord for questions
• [X] I'm not able to find an open issue that requests the same enhancement

Problem

Codebase retrieval could use Cohere's Embed models

Solution

Add supporting code under core/indexing/embeddings.

Maybe the bulk embed job API could be handy

[maxbrunet]

@sestinj feel free to assign this one to me, I will try to take care of it next :)

[sestinj]

Awesome! Let me know if there's anything I can answer. I think the embeddings provider should be fairly straightforward. Embed jobs could certainly speed things up, but might be overkill in a lot of situations, as I'm assuming you'd then have to download the results and parse the CSV? With 96 inputs per /embed call that won't be terribly slow for most codebases.