dspy
dspy copied to clipboard
OllamaLocal Out of service?
System: Wsl-Ubuntu22.04 Python-Version: python3.10.12 Dspy-Version: 2.4.5 Ollama: In Windows Run Qwen:32b
When I use dspy ollamalocal to call, an error will be reported in the request package.
import dspy
import openai
from langchain_text_splitters import RecursiveCharacterTextSplitter
from dspy.retrieve.weaviate_rm import WeaviateRM
from qdrant_client import QdrantClient
from dspy.datasets import HotPotQA
from dspy.retrieve.qdrant_rm import QdrantRM
qwen32b_ollama = dspy.OllamaLocal(model='qwen:32b',max_tokens=2048,)
qwen32b_ollama('Hello? ')
EroMsg:
Traceback (most recent call last):
File "/home/cc/miniconda/envs/vllm_py10/lib/python3.10/site-packages/IPython/core/interactiveshell.py", line 3577, in run_code
exec(code_obj, self.user_global_ns, self.user_ns)
File "<ipython-input-14-bae9f1d86ba9>", line 1, in <module>
qwen32b_ollama('Hello?')
File "/home/cc/miniconda/envs/vllm_py10/lib/python3.10/site-packages/dsp/modules/ollama.py", line 171, in __call__
response = self.request(prompt, **kwargs)
File "/home/cc/miniconda/envs/vllm_py10/lib/python3.10/site-packages/dsp/modules/ollama.py", line 145, in request
return self.basic_request(prompt, **kwargs)
File "/home/cc/miniconda/envs/vllm_py10/lib/python3.10/site-packages/dsp/modules/ollama.py", line 104, in basic_request
response_json = response.json()
File "/home/cc/miniconda/envs/vllm_py10/lib/python3.10/site-packages/requests/models.py", line 975, in json
raise RequestsJSONDecodeError(e.msg, e.doc, e.pos)
requests.exceptions.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
Hope you can help me solve this problem, thank you