infinity icon indicating copy to clipboard operation
infinity copied to clipboard

Support embedding with "instructions" Again

Open DataLama opened this issue 9 months ago • 5 comments

Feature request

Hello,

First of all, thank you for developing infinity, an excellent package dedicated to inference for embedding models.

I am opening this issue to request support once again for the instructions feature discussed in issue #34.

From my understanding, to utilize the method added in UKPLab/sentence-transformers#2439 within infinity, it seems necessary to pass either prompt or prompt_name at this point.

Considering that the recently updated MMTEB has introduced an Instruction Retrieval evaluation category and that many models are being researched and developed as instruction-based embedding models, I believe integrating this feature into infinity would attract more users to the package.

Feel free to correct me if I’m mistaken.

Motivation

https://github.com/michaelfeil/infinity/issues/34

Your contribution

If you can provide a rough concept of how this feature should be integrated into infinity, I think I could submit a PR myself.

DataLama avatar Mar 06 '25 08:03 DataLama

+1

kenchan97 avatar Mar 13 '25 13:03 kenchan97

+1 but I think we can just concat prompt, sentence_to_embed and use that as instruction + sentence

furlat avatar Mar 20 '25 10:03 furlat

Hi,

is there a good example model which makes use of instructions?

wirthual avatar May 03 '25 21:05 wirthual

+1

kembala avatar Sep 02 '25 08:09 kembala

+1

Bhanu-py avatar Oct 29 '25 09:10 Bhanu-py