native-engine topic

List native-engine repositories

dash-infer

132
Stars
14
Forks
Watchers

DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including x86 and ARMv9.