milvus-sdk-csharp icon indicating copy to clipboard operation
milvus-sdk-csharp copied to clipboard

Add sparse float vector support

Open zhengbuqian opened this issue 2 years ago • 6 comments

Milvus 2.4 has added beta support to sparse float vector to allow efficient storing, indexing and searching of such vectors. The main targeted use case is to support learned sparse models such as SPLADE and statistics based methods such as BM25.

We need to add sparse float vector to C# SDK as well. See: https://github.com/milvus-io/milvus/issues/29419#issuecomment-2024887328 for more details.

Thanks a lot for the efforts!

zhengbuqian avatar Mar 28 '24 10:03 zhengbuqian

Thanks, absolutely! I've created a 2.4.0 milestone to start tracking that work.

Are you interested in working on adding this support?

roji avatar Mar 28 '24 10:03 roji

Hi Roji, I don't have any experiences working with c#, so I guess I won't be able to work on this. But this is not urgent(at least in the coming week) as we plan to provide sparse as a GA feature in the next major release, not in 2.4. PyMilvus is sufficient for 2.4.

zhengbuqian avatar Mar 28 '24 11:03 zhengbuqian

OK. I've just submitted #72 to bump the SDK version to 2.4 and start running tests against Milvus 2.4. I'll be looking at implementing 2.4 features at some point, if nobody else is available to work on them.

@zhengbuqian please feel free to open additional issues for 2.4 features, so that we track support for them!

roji avatar Mar 28 '24 13:03 roji