localllm topic

[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization

SqueezeAILab

A generalized information-seeking agent system with Large Language Models (LLMs).

KwaiKEG

Use your locally running AI models to assist you in your web browsing

n4ze3m

KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization

SqueezeAILab

Run MemGPT-AutoGEN-Local LLM Together

PromptEngineer48

A nifty little library for working with Ollama in Elixir.

lebrunel

MinimalChat is a lightweight, open-source chat application that allows you to interact with various large language models.

fingerthief