private-gpt icon indicating copy to clipboard operation
private-gpt copied to clipboard

Embedding reading PGPT_MODE key

Open egSat opened this issue 11 months ago • 0 comments

Hi all,

I'm installing privategpt 0.4.0. I've configured the setup with PGPT_MODE = openailike. Some of my settings are as follows: llm: mode: openailike max_new_tokens: 10000 context_window: 26000

embedding: mode: huggingface

huggingface: embedding_hf_model_name: ${PGPT_EMBEDDING_HF_MODEL_NAME:BAAI/bge-large-en-v1.5}

openai: api_base: http://172.20.0.2:5000/v1 api_key: EMPTY model: facebook/opt-125m prompt_style: "mistral"

But when trying to run the docker image I keep getting the error :

privategpt-20240307-private-gpt-1 | 17:26:15.713 [INFO ] private_gpt.settings.settings_loader - Starting application with profiles=['default', 'docker'] privategpt-20240307-private-gpt-1 | Traceback (most recent call last): privategpt-20240307-private-gpt-1 | File "", line 198, in _run_module_as_main privategpt-20240307-private-gpt-1 | File "", line 88, in _run_code privategpt-20240307-private-gpt-1 | File "/home/worker/app/private_gpt/main.py", line 5, in privategpt-20240307-private-gpt-1 | from private_gpt.main import app privategpt-20240307-private-gpt-1 | File "/home/worker/app/private_gpt/main.py", line 3, in privategpt-20240307-private-gpt-1 | from private_gpt.di import global_injector privategpt-20240307-private-gpt-1 | File "/home/worker/app/private_gpt/di.py", line 3, in privategpt-20240307-private-gpt-1 | from private_gpt.settings.settings import Settings, unsafe_typed_settings privategpt-20240307-private-gpt-1 | File "/home/worker/app/private_gpt/settings/settings.py", line 324, in privategpt-20240307-private-gpt-1 | unsafe_typed_settings = Settings(**unsafe_settings) privategpt-20240307-private-gpt-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^ privategpt-20240307-private-gpt-1 | File "/home/worker/app/.venv/lib/python3.11/site-packages/pydantic/main.py", line 164, in init privategpt-20240307-private-gpt-1 | pydantic_self.pydantic_validator.validate_python(data, self_instance=pydantic_self) privategpt-20240307-private-gpt-1 | pydantic_core._pydantic_core.ValidationError: 1 validation error for Settings privategpt-20240307-private-gpt-1 | embedding.mode privategpt-20240307-private-gpt-1 | Input should be 'huggingface', 'openai', 'sagemaker', 'ollama' or 'mock' [type=literal_error, input_value='openailike', input_type=str] privategpt-20240307-private-gpt-1 | For further information visit https://errors.pydantic.dev/2.5/v/literal_error privategpt-20240307-private-gpt-1 exited with code 1

I think in some part the embeddings model uses PGPT_KEY instead of the embedding->mode key. Or maybe I'm wrong with my settings?

thank you very much

egSat avatar Mar 07 '24 17:03 egSat