tflite-support icon indicating copy to clipboard operation
tflite-support copied to clipboard

Same RAM usage TFlite model on Xavier and CPU Laptop

Open STAROFWIND opened this issue 2 years ago • 0 comments

Hi all, I am working on optimization. I have a .h5 keras model named "model.h5" --> I pruned this model to become a smaller and slighter model named "pruned_model.h5". I converted 2 models to tflite (model.tflite and pruned_model.tflite). When I inference 2 models on CPU Laptop and Xavier. --> problem: The RAM usage is the same among models. I think a slighter model if convert to tflite will use less RAM than bigger model ? I also think about tf.config.experimental.set_memory_growth(gpu, True) of tensorflow, but it doesn't affect tflite model. Any help ? Thank you so much

STAROFWIND avatar Apr 14 '22 10:04 STAROFWIND