dspy icon indicating copy to clipboard operation
dspy copied to clipboard

OllamaLocal Out of service?

Open chengzi0103 opened this issue 9 months ago • 0 comments

System: Wsl-Ubuntu22.04 Python-Version: python3.10.12 Dspy-Version: 2.4.5 Ollama: In Windows Run Qwen:32b

When I use dspy ollamalocal to call, an error will be reported in the request package.

import dspy
import openai
from langchain_text_splitters import RecursiveCharacterTextSplitter
from dspy.retrieve.weaviate_rm import WeaviateRM
from qdrant_client import QdrantClient
from dspy.datasets import HotPotQA
from dspy.retrieve.qdrant_rm import QdrantRM
qwen32b_ollama = dspy.OllamaLocal(model='qwen:32b',max_tokens=2048,)
qwen32b_ollama('Hello? ')

EroMsg:

Traceback (most recent call last):
  File "/home/cc/miniconda/envs/vllm_py10/lib/python3.10/site-packages/IPython/core/interactiveshell.py", line 3577, in run_code
    exec(code_obj, self.user_global_ns, self.user_ns)
  File "<ipython-input-14-bae9f1d86ba9>", line 1, in <module>
    qwen32b_ollama('Hello?')
  File "/home/cc/miniconda/envs/vllm_py10/lib/python3.10/site-packages/dsp/modules/ollama.py", line 171, in __call__
    response = self.request(prompt, **kwargs)
  File "/home/cc/miniconda/envs/vllm_py10/lib/python3.10/site-packages/dsp/modules/ollama.py", line 145, in request
    return self.basic_request(prompt, **kwargs)
  File "/home/cc/miniconda/envs/vllm_py10/lib/python3.10/site-packages/dsp/modules/ollama.py", line 104, in basic_request
    response_json = response.json()
  File "/home/cc/miniconda/envs/vllm_py10/lib/python3.10/site-packages/requests/models.py", line 975, in json
    raise RequestsJSONDecodeError(e.msg, e.doc, e.pos)
requests.exceptions.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

Hope you can help me solve this problem, thank you

chengzi0103 avatar Apr 30 '24 03:04 chengzi0103