marsha

marsha copied to clipboard

aguillenv

depombo

Embed Llama.cpp into Marsha for local usage

1

Currently getting to the third stage with Llama 2 13B but failing there.

dfellis

dfellis

dfellis

Running on Windows Results in error

8

C:\Users\jpeng\Documents\business\ai\marsha\marsha>python -m marsha tesseract.mrsh Compiling functions for tesseract... Generating Python code... Chat query took 15sec 553.156ms, started at 44.45ms, ms/chars = 12.363398965856797 Chat query took 24sec 196.805ms, started at 26.371ms,...

JohnPeng47

SudoLang

1

Hi there !. May Sudolang be taken as a design template for structural modifications of this product ? I see some points in common https://github.com/paralleldrive/sudolang-llm-support/blob/main/sudolang.sudo.md

GabCores

Use llama.cpp with Python grammar syntax

1

llama.cpp just implemented a feature that forces the llm to conform to arbitrary grammar, like, say, Python: https://github.com/ggerganov/llama.cpp/pull/1773 This seems relevant for this repo. Maybe the grammar could even be...

AlphaAtlas

wip: pg example

3

Resolves #94

aguillenv

depombo