dspy icon indicating copy to clipboard operation
dspy copied to clipboard

Published 20 hours ago • verified publisher icon stanfordnlp

Add llama-cpp python support

Open DanielUH2019 opened this issue 1 year ago • 2 comments

This changes allows running some large models on CPU locally. Let me know how I can improve it

DanielUH2019 avatar Oct 26 '23 07:10 DanielUH2019

@DanielUH2019 just following up on old PRs :), Could you resolve relevant conflicts and lmk when ready to merge?

arnavsinghvi11 avatar Apr 13 '24 02:04 arnavsinghvi11

@arnavsinghvi11 there's a new PR up as a continuation of this effort. it includes the snippet used to test against openhermes with llamacpp: https://github.com/stanfordnlp/dspy/pull/862

codysnider avatar Apr 18 '24 18:04 codysnider

Closing this PR with #862 close to merging

arnavsinghvi11 avatar May 11 '24 18:05 arnavsinghvi11