pentium3

FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU

1

https://arxiv.org/pdf/2303.06865.pdf

Fast Distributed Inference Serving for Large Language Models

1

https://arxiv.org/pdf/2305.05920.pdf

https://arxiv.org/pdf/2312.05516.pdf

https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10046087

https://proceedings.neurips.cc/paper_files/paper/2022/file/2b4bfa1cebe78d125fefd7ea6ffcfc6d-Paper-Conference.pdf

https://arxiv.org/pdf/2306.12517.pdf

https://www.usenix.org/conference/atc21/presentation/romero

SHEPHERD: Serving DNNs in the Wild

1

https://www.usenix.org/conference/nsdi23/presentation/zhang-hong