executorch icon indicating copy to clipboard operation
executorch copied to clipboard

How to perform inference and gathering accuracy metrics on executorch model

Open mmingo848 opened this issue 1 year ago • 1 comments

Hi, I am having trouble finding solid documentation that explains how to do the following with executorch (stable):

  • Load in the exported .pte model
  • Run inference with images
  • Gather accuracy

I have applied quantization and other optimizations to the original model and exported it to .pte. I'd like to see the accuracy after these techniques were applied. I followed the following tutorial for exporting the model. If we can't do the above items on the directly exported .pte file, then is there a way we can based on the below steps for preparing the model for edge dialect?

https://pytorch.org/executorch/stable/tutorials/export-to-executorch-tutorial.html

mmingo848 avatar Mar 13 '24 14:03 mmingo848

@mmingo848 We'll be publishing a solution to this - hopefully very soon!

mikekgfb avatar May 13 '24 00:05 mikekgfb