llm-inference topic

GPU environment and cluster management with LLM support

run-ai

Bespoke Automata is a GUI and deployment pipline for making complex AI agents locally and offline

C0deMunk33

Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).

inferflow

Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and minimal learning curve.

kyegomez

Aoororachain is Ruby chain tool to work with LLMs

mariochavez

A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.

IlyasMoutawwakil

Code for ACL 2024 paper "TruthX: Alleviating Hallucinations by Editing Large Language Models in Truthful Space"

ictnlp

Morpheus - A Network For Powering Smart Agents - Compute + Code + Capital + Community

MorpheusAIs

This is suite of the hands-on training materials that shows how to scale CV, NLP, time-series forecasting workloads with Ray.

ray-project

Deploy and Scale LLM-based applications

ray-project