tflite-runtime icon indicating copy to clipboard operation
tflite-runtime copied to clipboard

tf.lite is x40 faster than tflite_runtime.interpreter

Open JasseurHadded1 opened this issue 2 years ago • 0 comments

Hi, I have a tflite qunatized model (int8), The model running with

import tensorflow as tf
interpreter = tf.lite.Interpreter(model_path=model_path,
                                experimental_delegates=[])

is 40x faster than:

import tflite_runtime.interpreter as tflite
interpreter = tflite.Interpreter(model_path=model_path,
                                experimental_delegates=[])

Any explications? I have to used the tflite_runtime to run the model with USB google coral

Thanks

JasseurHadded1 avatar Jan 26 '23 11:01 JasseurHadded1