haystack-core-integrations icon indicating copy to clipboard operation
haystack-core-integrations copied to clipboard

`llama.cpp` transfer

Open d-kleine opened this issue 10 months ago • 3 comments

Hi guys,

Just a quick heads-up that llama.cpp will be moved from ggerganov/llama.cpp to ggml-org/llama.cpp Source: https://github.com/ggerganov/llama.cpp/discussions/11801

Might impact the integration of llama.cpp, at least the docs (I have raised an issue on llama-cpp-python too)

d-kleine avatar Feb 11 '25 14:02 d-kleine

I did a quick check, and it seems that the links in docs and in the integration page are not affected, because:

  • llama.cpp repo was moved and now there are redirects (https://github.com/ggml-org/llama.cpp/discussions/11801#discussioncomment-12167670)
  • some links refer to the library we use, which is https://github.com/abetlen/llama-cpp-python (Python bindings for llama.cpp)

However, in the long run, we should replace llama.cpp links in docs and integration page (not llama-cpp-python links).

anakin87 avatar Feb 21 '25 13:02 anakin87

@anakin87 just checking did you do this recently in your update to Llama cpp?

sjrl avatar Aug 11 '25 06:08 sjrl

I did this for docstrings in the integration.

Docs and integration page are still to be updated. In any case, the links work (there are redirects in place).

anakin87 avatar Aug 11 '25 08:08 anakin87