George
George
Pystemmer is a C library wrapper which enhances the speed of the tokenizer I ran the following benchmark with and without it: ``` import time from snowballstemmer import stemmer s...
Hey @xxx1099836595 Sorry for the late response! Unfortunately, the model authors haven't converted the model to onnx and we might not be able to invest time into the conversion of...
Hey @chitralverma @yudumpacin Unfortunately, the model authors haven't converted it to onnx and we might not be able to invest time into conversion of the models in the foreseeable future...
Hi @satyaloka93 You want to put the same files as in HF hub to the cache directory and initialize from them. We are not talking about some custom models /...
This functionality has been added as of fastembed v0.6.0 and can be used with `specific_model_path` argument An example of using it: ```python from fastembed import TextEmbedding emb = TextEmbedding("sentence-transformers/all-MiniLM-l6-v2", specific_model_path="my_model")...
Hey @qxpf666 Sorry for the late response As of fastembed v0.6.0 it is possible to add models to fastembed in runtime via `.add_custom_model` interface We might not be able to...
As of fastembed 0.6.0 It is possible to add this model in runtime via the following code snippet ```python from fastembed import TextEmbedding from fastembed.common.model_description import PoolingType, ModelSource TextEmbedding.add_custom_model( model="intfloat/multilingual-e5-small",...
hi @0110G Actually, I've encountered several cases, when onnx model was slower on mac os, the issue might be in onnxruntime
@quanduongduc with this approach you would need to be careful with the postprocessing required by particular models, some models require pooling onnx output, some of them don't. You'd need to...
It is now possible to add models to fastembed in runtime via [the official api](https://github.com/qdrant/fastembed#:~:text=from%20fastembed%20import%20TextEmbedding%0Afrom,.embed(documents))) However, it is still require the model to be in onnx and only supports a...