cpu-inference topic

List cpu-inference repositories

Llama-2-Open-Source-LLM-CPU-Inference

946
Stars
210
Forks
Watchers

Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A

llm.f90

54
Stars
1
Forks
Watchers

LLM inference in Fortran

fast-llama

86
Stars
8
Forks
Watchers

Runs LLaMA with Extremely HIGH speed