Novak Zivanic

Results 3 comments of Novak Zivanic

Just to mention that I'm also running into the same issue again. I'm using version 1.0 ![image](https://github.com/huggingface/text-embeddings-inference/assets/38144124/4d433dba-6350-4e2b-ab55-706d4f689e13)

I'm sending you docker stats before and after running a simple test, with around 25k requests to the server(each of the requests has between 100 and 1000 texts to embed...

I ran the tests again, and this time both services were killed graph of memory consumption: ![image](https://github.com/huggingface/text-embeddings-inference/assets/38144124/ae2dd478-a1ac-4696-9304-617be0166aa2)