llm-inference topic

Sparsity-aware deep learning inference runtime for CPUs

neuralmagic

OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference

openvinotoolkit

The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, and more.

Mintplex-Labs

🦙 Free and Open Source Large Language Model (LLM) chatbot web UI and API. Self-hosted, offline capable and easy to setup. Powered by LangChain.

vemonet

Superduper: Integrate AI models and machine learning workflows with your database to implement custom AI applications, without moving your data. Including streaming inference, scalable model hosting,...

superduper-io

irresponsible innovation. Try now at https://chat.dev/

anarchy-ai

AI-powered cybersecurity chatbot designed to provide helpful and accurate answers to your cybersecurity-related queries and also do code analysis and scan analysis.

morpheuslord

A library to communicate with ChatGPT, Claude, Copilot, Gemini, HuggingChat, and Pi

ugorsahin

Inference Llama 2 in one file of pure Zig

cgbur

🪶 Lightweight OpenAI drop-in replacement for Kubernetes

chenhunghan