text-embeddings-inference icon indicating copy to clipboard operation
text-embeddings-inference copied to clipboard

Published 20 hours ago • verified publisher icon huggingface

Support Alibaba-NLP/gte-multilingual-base & Alibaba-NLP/gte-multilingual-reranker-base

Open sigridjineth opened this issue 1 year ago • 3 comments

Model description

The GTE model family has consistent support on Hugging Face TEI, but the newly introduced gte-multilingual-base fails to be supported at this moment.

2024-08-03T08:44:51.913133Z  INFO download_pool_config: text_embeddings_core::download: core/src/download.rs:38: Downloading `1_Pooling/config.json`
2024-08-03T08:44:52.701241Z  INFO download_new_st_config: text_embeddings_core::download: core/src/download.rs:62: Downloading `config_sentence_transformers.json`
2024-08-03T08:44:52.885881Z  INFO download_artifacts: text_embeddings_core::download: core/src/download.rs:21: Starting download
2024-08-03T08:44:52.885905Z  INFO download_artifacts: text_embeddings_core::download: core/src/download.rs:23: Downloading `config.json`
2024-08-03T08:44:53.270526Z  INFO download_artifacts: text_embeddings_core::download: core/src/download.rs:26: Downloading `tokenizer.json`
2024-08-03T08:44:53.749799Z  INFO download_artifacts: text_embeddings_backend: backends/src/lib.rs:331: Downloading `model.safetensors`
2024-08-03T08:44:57.772619Z  INFO download_artifacts: text_embeddings_core::download: core/src/download.rs:32: Model artifacts downloaded in 4.886736258s
Error: `config.json` does not contain `id2label`

The same error happens for both biencoder and reranker.

Open source status

  • [X] The model implementation is available
  • [X] The model weights are available

Provide useful links for the implementation

https://huggingface.co/Alibaba-NLP/gte-multilingual-base https://huggingface.co/Alibaba-NLP/gte-multilingual-reranker-base

sigridjineth avatar Aug 03 '24 08:08 sigridjineth