generative-inference topic

List generative-inference repositories

HexGen

30
Stars
8
Forks
Watchers

Serving LLMs on heterogeneous decentralized clusters.

Traffic-flow-prediction

16
Stars
3
Forks
Watchers

This work considers combine multi-tricks with highway network to achieve traffic flow prediction accurately.