private-gpt icon indicating copy to clipboard operation
private-gpt copied to clipboard

Cannot access Mistral and the GUI does not recogize the loaded document

Open KansaiTraining opened this issue 9 months ago • 2 comments

i am trying to run PrivateGPT for the first time. I have installed Llama and a service is running at the moment. I have cloned the repo, install the poetry dependencies (poetry install --extras "ui llms-ollama embeddings-ollama vector-stores-qdrant" )and then pull

ollama pull mistral
ollama pull nomic-embed-text

I do not understand what

make sure the Ollama desktop app is closed.

means I do not call ollama serve since it is already running (that is how it is in the latest ollama)

The two problems I have are

  1. first it comes when I do PGPT_PROFILES=ollama make run

A lot of errors come out but basically it is this one

OSError: You are trying to access a gated repo.
Make sure to have access to it at https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2.
401 Client Error. (Request ID: Root=1-664ac2d9-648ebce1202a3b494633c746;52185420-fabc-421f-9fb9-627f32bfac6a)

Cannot access gated repo for url https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2/resolve/main/config.json.
Access to model mistralai/Mistral-7B-Instruct-v0.2 is restricted. You must be authenticated to access it.

I investigated already, went to the huggingface site and learned that you need authorization to use this model **NOTE: If I need authorization from a third party, doesnt that mean this is not private anymore??

Anyway, I solved that with

poetry run huggingface-cli login <TOKEN>

and it says that now I am loggined and authorized

However, running private gpt still gives me the same error. Even though I have been authorized to use the model

  1. Even though these errors appear, the GUI runs So I upload a csv file there and then I ask questions about the document but the system tells me they dont know anything about the document. I don't know if both errors are related to one another but now I can not use privateGPT so

Any help greatly appreciated

KansaiTraining avatar May 20 '24 06:05 KansaiTraining