inference-optimization topic
XNNPACK
High-efficiency floating-point neural network inference operators for mobile, server, and Web
graphsignal-python
Graphsignal Tracer for Python
inter-operator-scheduler
[MLSys 2021] IOS: Inter-Operator Scheduler for CNN Acceleration
pytorch_bn_fusion
Batch normalization fusion for PyTorch
TASO
The Tensor Algebra SuperOptimizer for Deep Learning
Keras-inference-time-optimizer
Optimize layers structure of Keras model to reduce computation time
PyTorch-Onnx-Tensorrt
A set of tool which would make your life easier with Tensorrt and Onnxruntime. This Repo is designed for YoloV3
BladeDISC
BladeDISC is an end-to-end DynamIc Shape Compiler project for machine learning workloads.