localllm topic

[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization

SqueezeAILab

A generalized information-seeking agent system with Large Language Models (LLMs).

KwaiKEG

Use your locally running AI models to assist you in your web browsing

n4ze3m

[NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization

SqueezeAILab

Run MemGPT-AutoGEN-Local LLM Together

PromptEngineer48

A nifty little library for working with Ollama in Elixir.

lebrunel

MinimalChat is a lightweight, open-source chat application that allows you to interact with various large language models.

fingerthief

MVP of an idea using multiple local LLM models to simulate and play D&D

tegridydev

OpenLocalUI: Native desktop app for Windows, MacOS and Linux. Easily run Large Language Models locally, no complex setups required. Inspired by OpenWebUI's simplicity for LLM use.

WilliamKarolDiCioccio