[Howto]: set up the llm studio Meta-Llama-3-8B-Instruct-GGUF model in gpt pilot 0.2 in local system

[DeveBj]

Version

Command-line (Python) version

Operating System

Windows 11

Your question

Hello,

am trying to setup the gpt pilot in my local system where am trying to use the model Meta-Llama-3-8B-Instruct-GGUF installed via llm studio also am running the server, having the below config but am getting the error while am running the python main.py command.

Error-

Error parsing config file config.json: 3 validation errors for Config openai Extra inputs are not permitted [type=extra_forbidden, input_value={'api_key': 'your_openai_api_key'}, input_type=dict]
For further information visit https://errors.pydantic.dev/2.7/v/extra_forbidden lm-studio Extra inputs are not permitted [type=extra_forbidden, input_value={'base_url': 'http://loca...0, 'read_timeout': 10.0}, input_type=dict] For further information visit https://errors.pydantic.dev/2.7/v/extra_forbidden models Extra inputs are not permitted [type=extra_forbidden, input_value={'Meta-Llama-3-8B-Instruc...-Instruct-Q4_K_M.gguf'}}, input_type=dict]

config.json-

{ "openai": { "api_key": "your_openai_api_key" }, "agent": { "default": { "provider": "lm-studio", "model": "Meta-Llama-3-8B-Instruct-GGUF" } }, "lm-studio": { "base_url": "http://localhost:1234/v1/", "api_key": "your_api_key_here", "connect_timeout": 60.0, "read_timeout": 10.0 }, "models": { "Meta-Llama-3-8B-Instruct-GGUF": { "model_path": "C:/Users/test/.cache/lm-studio/models/lmstudio-community/Meta-Llama-3-8B-Instruct-GGUF/Meta-Llama-3-8B-Instruct-Q4_K_M.gguf" } } }

appreciate any one's help, thanks!