dspy

dspy copied to clipboard

Add type hints to signature.py

1

Address #962 This is substantially complicated by the use of Pydantic. /cc @thomasahle

rpgoldman

Llama 3 models not stopping when using VLLM as a client

2

Steps to repoduce: ```python import dspy vllm_llama3_70b = dspy.HFClientVLLM(model="meta-llama/Meta-Llama-3-70B-Instruct", port=8000, url="http://localhost") dspy.configure(lm=vllm_llama3_70b) #Example DSPy CoT QA program qa = dspy.ChainOfThought('question -> answer') response = qa(question="What is the capital of Australia?")...

DanielProkhorov

TypedChainOfThought throw ValueError: 'Too many retries trying to get the correct output format. Try simplifying the requirements.'

11

In some cases the `TypedChainOfThought` would throw the following error, but `TypedPredictor` would work fine. ``` ValueError: ('Too many retries trying to get the correct output format. Try simplifying the...

StevenGuo42

`_parse_signature()` in [signature.py](https://github.com/stanfordnlp/dspy/blob/main/dspy/signatures/signature.py) is declared as returning a `Tuple` but it returns a dictionary. I checked and mypy confirms this: Incompatible return value type (got "dict[Any, tuple[Any, Any]]", expected "tuple[type[Any],...

rpgoldman

Hi Team, I was trying to replicate the [example](https://github.com/stanfordnlp/dspy/issues/661#issuecomment-2001084556) for fine-tuning LM using SQL queries, I am using "from langchain_openai import AzureChatOpenAI" as LM and getting the following error when...

pragyan019

How to best use TypedPredictors?

3

I want to extract information using pydantic types, and generate many examples like in the Readme. ```python from pydantic import BaseModel, Field from typing import Literal from dspy.functional import TypedPredictor...

arunpatro

Add docstrings and type hints to Evaluate class.

6

Add docstrings and type hints for the Evaluate class. Needs review!

rpgoldman

LLama 3 70B performing poorly in RAG: import dspy from dspy import Signature from chroma_db_retriever import ChromadbRM from rag_config import RAGConfig rag_config = RAGConfig() from chromadb.utils import embedding_functions sentence_transformer_ef =...

Dyke-F

Exception: Received invalid JSON response from server

1

```py # install DSPy: pip install dspy import dspy # This sets up the language model for DSPy in this case we are using mistral 7b through TGI (Text Generation...

andysingal

Hey, just noticed that if using groq to call models, there's no clear dependency chain to include it. So dependency `groq` has to be added separately for things to work....

jonasdebeukelaer