RTNeural
RTNeural copied to clipboard
Comparison of this framework’s performance with other inference frameworks:
Has anyone compared this framework’s runtime efficiency with TensorFlow Lite, MNN, or NCNN?
The RTNeural-compare repository has some performance comparisons between RTNeural, libtorch, TensorFlow Lite, and the ONNX runtime, mostly broken down by layer type and size. Comparisons with additional inference engines would definitely be nice, if you or anyone else is interested in contributing!