Awesome-LLM-Inference icon indicating copy to clipboard operation
Awesome-LLM-Inference copied to clipboard

Published 20 hours ago • verified publisher icon DefTruth
→

Metadata

📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.

Results 0 Awesome-LLM-Inference issues
Sort by recently updated
recently updated
newest added

← Metadata

2.6k
Stars
175
Forks
Watchers

Owner

verified publisher icon DefTruth

Metadata

📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.

Back