dspy

dspy copied to clipboard

How to convert a AutoModelForCausalLM object to a dspy model object?

5

import dspy llm = dspy.HFModel(model='model') This method takes a string as input for the model if i have a quantized model object of the class AutoModelForCausalLM How i can convert...

pawanGithub10

Refactor existing HuggingFace support to a more robust one

12

Current status: WIP The PR motivation started from this issue: #1018 ### What this PR do? We have an existing HuggingFace model integration on DsPY. However developers can not use...

Anindyadeep

Add logprobs hfclientvllm

7

This is part of https://github.com/stanfordnlp/dspy/issues/879. I tested it and it behaves the same as the other PR. ``` lm = dspy.HFClientVLLM(model="NurtureAI/Meta-Llama-3-8B-Instruct-32k", port=38242, url="http://localhost", max_tokens=4) test_text = "This is a test...

tom-doerr

Failed to parse JSON response: {"detail":"Not Found"}

6

The code im running: ``` lm = dspy.HFClientVLLM(model="NurtureAI/Meta-Llama-3-8B-Instruct-32k", port=38242, url="http://localhost", max_tokens=4) test_text = "This is a test article. abc" output_normal = lm(test_text) print("output_normal:", output_normal) ``` I start the server with:...

tom-doerr

Using OllamaEmbedding as retriever ?

1

Hi, I was trying to workout a solution with OllamaEmbedding as a retriever. However got the following error : ### File ~/miniconda3/envs/RAG/lib/python3.11/site-packages/dsp/primitives/search.py:12, in retrieve(query, k, **kwargs) [10](https://file+.vscode-resource.vscode-cdn.net/Users/tharsan.senthivel.cyu/Code/RAG/~/miniconda3/envs/RAG/lib/python3.11/site-packages/dsp/primitives/search.py:10) if not dsp.settings.rm:...

thad75

[Feature-Request] Support for GPT Vision

9

I have already tried a solution suggested by @truebit, for this, earlier, without any luck - I have documented my attempt a little here: _Originally posted by @antoan in https://github.com/stanfordnlp/dspy/issues/459#issuecomment-1987333865_

antoan

[Feature Request] Better Typed Predictors for Reliable JSON Generation

15

The [Typed Predictors](https://github.com/stanfordnlp/dspy/blob/7227e7081d8edc3d0ffc2729f7c97871aa61338b/dspy/functional/functional.py#L72) output JSON as plain text. They do not use function calling method/template and do not enforce the output to be a valid JSON. This makes generating structured...

StevenGuo42

DSPy Typed Predict is not extracting the LLM output correctly.

7

I am trying to use the TypePredictor to extract information from some inputs. The program failed due to exceeding number of retries but when inspecting the output of the LLM...

felixgao

Does it make sense to remove the `dspy.` if a class is not actually accessible over it? In case that's wanted it might make sense to actually allow access with...

tom-doerr

feat(dspy) PremAI python sdk

9

This PR adds a integration of [premai](https://premai.io) [python sdk](https://github.com/premAI-io/prem-python-sdk) to dspy modules. Fixes issue: #1006

Anindyadeep