inference-engines topic
List
inference-engines repositories
CNN-Inference-Engine-Quick-View
150
Stars
18
Forks
Watchers
A quick view of high-performance convolution neural networks (CNNs) inference engines on mobile devices.
stable-fast
1.2k
Stars
70
Forks
Watchers
Best inference performance optimization framework for HuggingFace Diffusers on NVIDIA GPUs.
benchmarks
129
Stars
5
Forks
Watchers
🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.