10htts
10htts
I'm running llama2 in LMStudio and I'm running theses: ``` $Env:LLM_API_KEY="lm-studio" $Env:LLM_MODEL="ollama/llama2" $Env:LLM_BASE_URL="http://localhost:1234/v1" $Env:LLM_EMBEDDING_MODEL="local" # can be "llama2", "openai", "azureopenai", or "local" $Env:WORKSPACE_DIR = "C:\Users\Bob\Desktop\OpenDevin\OpenDevin\opendevin\Project01" python -m pip install -r...
Think I found why here: https://github.com/BerriAI/litellm?tab=readme-ov-file#supported-providers-docs llama 2 does not support [Embedding](https://docs.litellm.ai/docs/embedding/supported_embedding)?
I get this error now: [ERROR] Unexpected endpoint or method. (POST /v1/api/embeddings). Returning 200 anyway Started from scratch with LMStudio (Running nitsuai/llama-2-70b-Guanaco-QLoRA-GGUF/llama-2-70b-guanaco-qlora.Q3_K_S.gguf) and these parameters for LiteLLM: $Env:LLM_API_KEY="lm-studio" $Env:LLM_MODEL="nitsuai/llama-2-70b-Guanaco-QLoRA-GGUF/llama-2-70b-guanaco-qlora.Q3_K_S.gguf" #...