autogen icon indicating copy to clipboard operation
autogen copied to clipboard

[Feature Request]: Add e5mistral7B embeddings model capability

Open Josephrp opened this issue 1 year ago • 0 comments

Is your feature request related to a problem? Please describe.

embeddings models works but:

  • their context windows are small
  • embeddings are not context or content dependent

the new e5mistral7B model from microsoft is the first embeddings model to be called via prompting allowing for adaptive embeddings based on content and hopefully better outcomes during retrieval.

Describe the solution you'd like

a modified retrieval agent that is compatible with prompting for embedding .

Additional context

check out the new e5mistral7B model here : https://huggingface.co/intfloat/e5-mistral-7b-instruct here's my demo for e5mistral7B : https://huggingface.co/spaces/Tonic1/e5

I've started working on this issue in a branch of our project. You can find the relevant changes here: Tonic-AI/community/autogen at /issue-add-e5-embeddings/autogen

Josephrp avatar Jan 15 '24 09:01 Josephrp