LocalAI

LocalAI copied to clipboard

mkellerman

Config files

1

This PR adds a first step into having a configuration mechanism for LocalAI. Fixes: https://github.com/go-skynet/LocalAI/issues/28 It introduces two way of configuring LocalAI "virtual models": a single YAML file containing all...

mudler

This issue lists Renovate updates and detected dependencies. Read the [Dependency Dashboard](https://docs.renovatebot.com/key-concepts/dashboard/) docs to learn more. ## Open These updates have all been created already. Click a checkbox below to...

renovate[bot]

feature: GPU/CUDA support?

4

Please close this if it's off-topic or ill informed. LocalAI seems to be focused on providing an OpenAI-compatible API for models running via CPU, (llama.cpp, ggml). I was excited about...

tensiondriven

Improving the chat endpoint to work with ``, `` and `` flags, including a model completion template for llama. Issues: Using `` as a stopword causes llama to output an...

normen

feature: stopwords

1

Stopwords are implemented in the go-llama.cpp backend, however, the same should be ported to: - [x] go-llama.cpp - [ ] go-gpt4all-j.cpp - [ ] go-gpt2.cpp - [x] rwkv

mudler

feature: embedding support

3

Add support to embeddings to the API and the llama backend: https://github.com/ggerganov/llama.cpp/blob/e4422e299c10c7e84c8e987770ef40d31905a76b/llama.cpp#L2160 - [x] go-llama.cpp - [ ] go-gpt4all-j.cpp - [ ] go-gpt2.cpp

mudler

error: llama: model does not exist gpt: model does not exist gpt2: model does not exist stableLM: model does not exist

2

Hi there, First of all, I managed to compile the binary using `make build`, it produced an executable file `local-ai`. I started the local-ai using the following command: ``` ./local-ai...

limcheekin

Hi there, Thanks for sharing the codes. May I know any plan to support ChatML? You can find out more about ChatML with the following links: https://github.com/openai/openai-python/blob/main/chatml.md https://cobusgreyling.medium.com/the-introduction-of-chat-markup-language-chatml-is-important-for-a-number-of-reasons-5061f6fe2a85 Thanks.

limcheekin

feature: identify model file by SHA

5

If the API would support model aliases that would allow to plug into existing webui more easily, without supporting directly each one of them. Seems all the UI out there...

mudler