inference-engines topic
List
inference-engines repositories
CNN-Inference-Engine-Quick-View
150
Stars
18
Forks
Watchers
A quick view of high-performance convolution neural networks (CNNs) inference engines on mobile devices.
stable-fast
992
Stars
55
Forks
Watchers
Best inference performance optimization framework for HuggingFace Diffusers on NVIDIA GPUs.
benchmarks
109
Stars
3
Forks
Watchers
🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.