Fardjad Davari

Given the following OpenAPI Spec document: ``` openapi: "3.0.0" info: title: Test API version: 1.0.0 servers: - url: http://localhost:5000 paths: '/items/{ids}': get: parameters: - schema: type: array items: type: string...

llama-node/llama-cpp uses more memory than standalone llama.cpp with the same parameters

3

I'm trying to process a large text file. For the sake of reproducibility, let's use [this](https://baconipsum.com/api/?type=meat-and-filler&paras=10&format=text). The following code: Expand to see the code ```javascript import { LLM } from...

Replace the default adapter with an adapter that uses node-llama-cpp

2

Regrettably, [llama-node](https://github.com/Atome-FE/llama-node) hasn't seen updates in quite some time. On the other hand, [node-llama-cpp](https://github.com/withcatai/node-llama-cpp) appears to be under active development. It would be nice to update the [default adapter](https://github.com/fardjad/node-llmatic/blob/master/src/default-llm-adapter.ts) to...