py-gpt icon indicating copy to clipboard operation
py-gpt copied to clipboard

Using custom embedding endpoint

Open cmkeane-agi opened this issue 7 months ago • 1 comments

I am trying to get the system to recognize a custom embedding endpoint to use a special embedding model. The system serving it is openai api compliant with the /v1/embeddings path. My full embedding endpoint is: http://embedder.example.com:8000/v1/embeddings.

I have tried in the llamaindex embedding settings to set it to openai and change the OPENAI_API_BASE to http://embedder.example.com:8000. Also tried with adding /v1 and /v1/embeddings. It always timeouts with can't connect. When I look at the embedder log, it shows no attempts.

I have no problem otherwise utilizing this endpoint directly in python, for instance.

Should I be taking another approach?

cmkeane-agi avatar Jul 12 '24 18:07 cmkeane-agi