private-gpt icon indicating copy to clipboard operation
private-gpt copied to clipboard

[Feature Request] Support Ollama Embedding

Open huaxlin opened this issue 1 year ago • 1 comments

Motivation

Ollama has been supported embedding at v0.1.26 - Support for bert and nomic-bert embedding models

I think it's will be more easier ever before when every one get start with privateGPT, without extra setup step(python script/setup)

Usage^1

This model is an embedding model, meaning it can only be used to generate embeddings.

REST API

curl http://localhost:11434/api/embeddings -d '{
  "model": "nomic-embed-text",
  "prompt": "The sky is blue because of Rayleigh scattering"
}'

Python library

ollama.embeddings(model='nomic-embed-text', prompt='The sky is blue because of rayleigh scattering')

huaxlin avatar Feb 25 '24 10:02 huaxlin

This can be closed, using Ollama embeddings in my own project as we speak :)

Robinsane avatar Mar 13 '24 10:03 Robinsane

supported ollama embedding, refer to settings-ollama.yaml

huaxlin avatar Apr 12 '24 18:04 huaxlin