text-embeddings-inference

text-embeddings-inference copied to clipboard

Short inputs cause /embed to randomly return empty vectors.

5

### System Info version: text-embedding-inference 1.6.1 OS: ubuntu 24.04 python: 3.12.3 Embedding short (single-word) inputs randomly cause null vectors. ### Information - [x] Docker - [x] The CLI directly ###...

superkelvint

Moving to `uv` to enable dependency override and cleaner locks

1

# What does this PR do? Fixes # (issue) ## Before submitting - [ ] This PR fixes a typo or improves the docs (you can dismiss the other checks...

Narsil

Support for jina-reranker-v2-base-multilingual

1

### System Info none ### Information - [ ] Docker - [ ] The CLI directly ### Tasks - [ ] An officially supported command - [ ] My own...

icyxp

Support for Linq-AI-Research/Linq-Embed-Mistral

3

### Model description The model is the top opensource model on the https://huggingface.co/spaces/mteb/leaderboard so please add it. ### Open source status - [x] The model implementation is available - [x]...

thunder-007

Could not start backend: cannot find tensor embeddings.word_embeddings.weight

10

### System Info docker ``` docker run \ -d \ --name reranker \ --gpus '"device=0"' \ --env CUDA_VISIBLE_DEVICES=0 \ -p 7863:80 \ -v /data/ai/models:/data \ ghcr.io/huggingface/text-embeddings-inference:86-1.5 \ --model-id "/data/bge-reranker-base" \...

momomobinx

new model lier007/xiaobu-embedding-v2

3

### Model description https://huggingface.co/lier007/xiaobu-embedding-v2 The model has additional Dense,. I translate the model to onnx format by "https://huggingface.co/TencentBAC/Conan-embedding-v1", but it only output 1024 dimensions, but it should be 1792 ###...

Mars-1990

TEI error for jinaai/jina-embeddings-v3 missing field `model_type` at line 51 column 1

3

### System Info I would like to use jinaii embedding & reranker but not working error "missing field `model_type` at line 51 column 1" King regards, David. ``` (HF_TEI) :~$...

dromeuf

Build failed due to `half` and `rand` issue

3

### system environment ``` cargo 1.85.0 (d73d2caf9 2024-12-31) ``` ### build command ``` cargo install --path router -F candle-cuda -F http --no-default-features ``` ### build errors ``` error[E0277]: the trait...

lytning98

Support for GPU and CPU in one Docker image

2

### Feature request I would like to request to have a single docker image for both CPU and GPU cases. This can be done using a combination of Dockerfile and...

saileshd1402

Error occurs when using ONNX model with text-embeddings-inference turing image

2

### System Info offline and airgapped ENV OS version: rhel8.19 Model: bge-m3 Hardware: NVIDIA GPU T4 Deployment: Kubernetes (kserve) Current version: turing-1.6 ### Information - [x] Docker - [ ]...

gogomasaru