private-gpt
private-gpt copied to clipboard
Cannot access Mistral and the GUI does not recogize the loaded document
i am trying to run PrivateGPT for the first time. I have installed Llama and a service is running at the moment.
I have cloned the repo, install the poetry dependencies (poetry install --extras "ui llms-ollama embeddings-ollama vector-stores-qdrant"
)and then pull
ollama pull mistral
ollama pull nomic-embed-text
I do not understand what
make sure the Ollama desktop app is closed.
means I do not call ollama serve since it is already running (that is how it is in the latest ollama)
The two problems I have are
- first it comes when I do
PGPT_PROFILES=ollama make run
A lot of errors come out but basically it is this one
OSError: You are trying to access a gated repo.
Make sure to have access to it at https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2.
401 Client Error. (Request ID: Root=1-664ac2d9-648ebce1202a3b494633c746;52185420-fabc-421f-9fb9-627f32bfac6a)
Cannot access gated repo for url https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2/resolve/main/config.json.
Access to model mistralai/Mistral-7B-Instruct-v0.2 is restricted. You must be authenticated to access it.
I investigated already, went to the huggingface site and learned that you need authorization to use this model **NOTE: If I need authorization from a third party, doesnt that mean this is not private anymore??
Anyway, I solved that with
poetry run huggingface-cli login <TOKEN>
and it says that now I am loggined and authorized
However, running private gpt still gives me the same error. Even though I have been authorized to use the model
- Even though these errors appear, the GUI runs So I upload a csv file there and then I ask questions about the document but the system tells me they dont know anything about the document. I don't know if both errors are related to one another but now I can not use privateGPT so
Any help greatly appreciated