inference-engines topic

List inference-engines repositories

CNN-Inference-Engine-Quick-View

150
Stars
18
Forks
Watchers

A quick view of high-performance convolution neural networks (CNNs) inference engines on mobile devices.

stable-fast

992
Stars
55
Forks
Watchers

Best inference performance optimization framework for HuggingFace Diffusers on NVIDIA GPUs.

benchmarks

109
Stars
3
Forks
Watchers

🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.