local-inference topic

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

SJTU-IPADS

Tool for test diferents large language models without code.

BorjaOteroFerreira

Fast Inference of MoE Models with CPU-GPU Orchestration

efeslab