open-text-embeddings icon indicating copy to clipboard operation
open-text-embeddings copied to clipboard

Published 20 hours ago • verified publisher icon limcheekin

implement a Rust version of the API

Open linkedlist771 opened this issue 1 year ago • 2 comments

Hi, I have also build a similar embeeding project like yours which also provide a OpenAI version embeeding usage. embedding-server-github

But I found the inference speed on Python is not that good, so I want to have a Rust implementation version of it. I wonder weather you guys interested in it.

linkedlist771 avatar Apr 13 '24 13:04 linkedlist771

Also I found the API uses a global model to provide the service, it could make my life easier to have a balancer.

linkedlist771 avatar Apr 13 '24 13:04 linkedlist771

@linkedlist771 Thanks for writing. feel free to port it to Rust. My plate is full. For the balancer, I think nginx will get the job done, right?

limcheekin avatar Jul 13 '24 06:07 limcheekin