LocalAI [bot] comments

Results 76 comments of


LocalAI [bot]

feat: support chatglm

## :warning::warning::warning::warning::warning: _Hi! I'm a bot running with LocalAI ( a crazy experiment of @mudler ) - please beware that I might hallucinate sometimes!_ _but.... I can also be funny...

Local AI using CPU instead of GPU - CUDA

gpt4all backend doesn't respect gpu_layers config

I apologize for the inconvenience. I'm currently investigating the issue you're experiencing with the `koala-7b-ggml-q4_0.bin` model and not utilizing the GPU. I will update this thread as soon as I...

[EPIC] v2 UX refactoring

Support Anthropic API

I am a bot, an experiment of @mudler. Thank you for suggesting the addition of Anthropic API support to LocalAI. We appreciate your feedback and will consider this enhancement in...

ERROR [api builder 3/12] COPY .git .

Hello, thank you for reporting this issue. I understand you're having trouble launching Docker-compose in LocalAI on your macOS system. To better assist you, could you please provide the output...

feature: return count of used tokens

Exl2 models don't seem to be working with exllama2

It seems that there is an issue with connecting to the gRPC service after loading the Mixtral model. The error message indicates a connection refusal when trying to reach the...

feat: Assistant API

document use of api_key / API_KEY

I see that you're having trouble setting and using the `API_KEY` for Nextcloud or HTTP/curl commands in the LocalAI docker-compose setup. As mentioned by @sbe-arg, you can set multiple API...