llm-inference topic

Completion After Prompt Probability. Make your LLM make a choice

kddubey

Create characters in Unity with LLMs!

undreamai

ht - a shell command that answers your questions about shell commands

catallo

[CVPR 2024] Prompt Highlighter: Interactive Control for Multi-Modal LLMs

dvlab-research

Tensor parallelism is all you need. Run LLMs on an AI cluster at home using any device. Distribute the workload, divide RAM usage, and increase inference speed.

b4rtaz

LLM (Large Language Model) FineTuning

rohan-paul

Embedding Studio is a framework which allows you transform your Vector Database into a feature-rich Search Engine.

EulerSearch

FineTune LLMs in few lines of code (Text2Text, Text2Speech, Speech2Text)

promptslab

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

InternLM

LLMs as Copilots for Theorem Proving in Lean

lean-dojo