llama.cpp icon indicating copy to clipboard operation
llama.cpp copied to clipboard

[Binding/UI] Node-RED node and flow for LLaMA

Open rozek opened this issue 2 years ago • 0 comments

Hi!

First of all: thank you very much for your marvellous contribution! Being able to run inferences on one's CPU is awesome!

Using llama.cpp as its workhorse, I have built function nodes and complete flows for Node-RED, which can be used to run inferences based on both LLaMA and Alpaca models.

Node-RED is a data flow processor which allows people ranging from none over casual up to professional programmers to build complex systems from within their browsers just by wiring components (aka "nodes") together.

Having LLaMA and Alpaca AI models as such nodes allows these people to create their own user interfaces or even build their own autonomous agents, always having full control over everything they do!

Thanks again for your contribution!

With greetings from Germany,

Andreas Rozek

rozek avatar Apr 22 '23 04:04 rozek