pymilvus icon indicating copy to clipboard operation
pymilvus copied to clipboard

[QUESTION]: Does pymilvus support float16 and/or bfloat16 embeddings?

Open BBC-Esq opened this issue 10 months ago • 3 comments

Is there an existing issue for this?

  • [X] I have searched the existing issues

What is your question?

Does pymilvus support float16 and/or bfloat16 embeddings? I am not referring to the "dtype" that an embedding model is being run with but rather the actual embeddings that are returned? For example, I know that tiledb, which I currently use, does not:

https://docs.tiledb.com/spark/supported-datatypes

Anything else?

No response

BBC-Esq avatar Jan 06 '25 20:01 BBC-Esq

@BBC-Esq Yes, Milvus and PyMilvus supports bf16 and fp16 embeddings

Ref to PyMilvus example: https://github.com/milvus-io/pymilvus/blob/master/examples/datatypes/float16_example.py https://github.com/milvus-io/pymilvus/blob/master/examples/datatypes/bfloat16_example.py

Ref to Milvus doc: Look for Supported data types: https://milvus.io/docs/schema.md

XuanYang-cn avatar Jan 07 '25 02:01 XuanYang-cn

Perfect, thank you. And if I switch my program from tiledb to you guys, what other differences are there?

BBC-Esq avatar Jan 07 '25 12:01 BBC-Esq

Sorry that I'm not familiar with tiledb, feel free to reach us when anything goes wrong during the switch, we're happy to offer helps on specific problems.

XuanYang-cn avatar Jan 22 '25 07:01 XuanYang-cn