nnstreamer icon indicating copy to clipboard operation
nnstreamer copied to clipboard

[Feature] tf-lite custom support

Open myungjoo opened this issue 3 years ago • 2 comments

Supposed Usage Example

  1. tensor_filter framework=tensorflow-lite-custom model=${path}.tflite fw_location=/usr/opt/app/whatsoever/tflite-custom-whatsoever.so
  2. ml-inf-single usage

Timeline: no specific due date, but let's try to release w/ Tizen 7.0 M2 (priority is lower than other established PLM/RELEASE tasks)

Plan A: use dlopen. get class instances of required tflite features.

Findings:

  1. Cannot use dlopen for getting tflite.so instance. It cannot be used for arbitrary tflite.so (need a "C" exported constructors and destructors of each tflite binary instance!)
  2. Plan A is inappropriate.

Plan B: let it be linked to "libtensorflow2-lite-custom.so" and user defines LD path in launch-time. This limits functionality a bit (cannot have multiple different custom tflite custom binaries for a given app.), but it will work. By default, let it try to load it from the "current" path of the app.

myungjoo avatar Apr 07 '22 09:04 myungjoo

:octocat: cibot: Thank you for posting issue #3713. The person in charge will reply soon.

taos-ci avatar Apr 07 '22 09:04 taos-ci

Plan B Issue: when libtensorflow-lite-custom.so is not available at the pipeline construction (tensor-filter loading), we need to generate proper (not killing the app) error!

myungjoo avatar Apr 18 '22 01:04 myungjoo

#4268 will complete this.

myungjoo avatar Oct 16 '23 02:10 myungjoo