llm-inference topic

Sparsity-aware deep learning inference runtime for CPUs

neuralmagic

OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference

openvinotoolkit

The all-in-one Desktop & Docker AI application with full RAG and AI Agent capabilities.

Mintplex-Labs

🦙 Free and Open Source Large Language Model (LLM) chatbot web UI and API. Self-hosted, offline capable and easy to setup. Powered by LangChain.

vemonet

🔮 SuperDuperDB: Bring AI to your database! Build, deploy and manage any AI application directly with your existing data infrastructure, without moving your data. Including streaming inference, scalab...

SuperDuperDB

irresponsible innovation. Try now at https://chat.dev/

anarchy-ai

AI-powered cybersecurity chatbot designed to provide helpful and accurate answers to your cybersecurity-related queries and also do code analysis and scan analysis.

morpheuslord

A library to communicate with ChatGPT, Claude, Copilot, Gemini, HuggingChat, and Pi

ugorsahin

Inference Llama 2 in one file of pure Zig

cgbur

🪶 Lightweight OpenAI drop-in replacement for Kubernetes

chenhunghan