llm-fp4 topic
List
llm-fp4 repositories
Awesome-LLM-Inference
1.5k
Stars
118
Forks
Watchers
📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.
