[FEATURE REQUEST]: llama.cpp wrapper

[collin-klippel]

The problem you are trying to solve:

Currently the library only provides a wrapper for OpenAi models.

Suggested new feature or change:

Add an LLM wrapper for llama.cpp akin to langchain's.

[collin-klippel]

Added this as a placeholder, might see if I can get something working this week 🤞 Thanks! 😄

[stoyan-stoyanov]

This would be awesome! Thank you! 🤞

[stoyan-stoyanov]

hey @collin-klippel are you still interested in this? If not I can take it next weekend. I am adding support for Claude and OpenAI Azure and I would like to add llama next :)

[collin-klippel]

@stoyan-stoyanov To be honest I don't think I will get to this soon, feel free to take it! :D

[stoyan-stoyanov]

Thanks! Good to know 😊