infinity

infinity copied to clipboard

docker image overwrite

1

## Related Issue ## Checklist - [ ] I have read the [CONTRIBUTING](https://github.com/michaelfeil/infinity/tree/main?tab=readme-ov-file#contribute-and-develop) guidelines. - [ ] I have added tests to cover my changes. - [ ] I have...

michaelfeil

Automated changes by [create-pull-request](https://github.com/peter-evans/create-pull-request) GitHub action

github-actions[bot]

### System Info image: michaelf34/infinity:0.0.76 configMap: - HF_HOME=/mnt/llm-models - INFINITY_LOG_LEVEL=debug - INFINITY_ANONYMOUS_USAGE_STATS=0 - INFINITY_MODEL_ID="vidore/colpali-v1.2-merged" - INFINITY_BATCH_SIZE=64 - INFINITY_PORT=7997 - INFINITY_DEVICE=cpu command: - infinity_emb - v2 ### Information - [x] Docker...

ch9hn

auto get modality

1

## Related Issue ## Checklist - [x] I have read the [CONTRIBUTING](https://github.com/michaelfeil/infinity/tree/main?tab=readme-ov-file#contribute-and-develop) guidelines. - [ ] I have added tests to cover my changes. - [ ] I have updated...

lloydzhou

Support `--dimensions` parameter in CLI

1

## Description Hi there! First off – thank you for `infinity`, it's a fantastic project that allows setting up OpenAI-compatible API quickly. I was integrating it with Typesense, which recently...

persiyanov

Support for Linq-AI-Research/Linq-Embed-Mistral

5

### Feature request `Linq-AI-Research/Linq-Embed-Mistral` is the top opensource model on the https://huggingface.co/spaces/mteb/leaderboard ### Motivation https://huggingface.co/Linq-AI-Research/Linq-Embed-Mistral ### Your contribution I am try run docker with it, not ok yet

calvin2021y

Support for models trained with SetFit for classification

5

### Feature request How can we use embedding models trained under setFit for classification using infinity. ### Motivation https://github.com/huggingface/setfit is a good library that allows fine tuning of embedding models...

S1LV3RJ1NX

Low throughput with modernbert

7

### System Info Testing https://huggingface.co/Alibaba-NLP/gte-reranker-modernbert-base ``` INFO 2025-02-11 20:36:37,724 infinity_emb INFO: select_model.py:64 model=`Alibaba-NLP/gte-reranker-modernbert-base` selected, using engine=`torch` and device=`cuda` You are attempting to use Flash Attention 2.0 with a model not...

rawsh-rubrik

Infinity embed crashes too easily

10

### System Info 0.0.74 ### Information - [X] Docker + cli - [ ] pip + cli - [ ] pip + usage of Python interface ### Tasks - [X]...

taoari

Late interaction models dimensions

3

Hello, first of all, nice work! I have been trying to understand the shapes of the colbert models. as far as I have seen the _**colbert-ir/colbertv2.0**_ has a dimension of...

ahmedtalbi