nnstreamer
nnstreamer copied to clipboard
[Feature] tf-lite custom support
Supposed Usage Example
- tensor_filter framework=tensorflow-lite-custom model=${path}.tflite fw_location=/usr/opt/app/whatsoever/tflite-custom-whatsoever.so
- ml-inf-single usage
Timeline: no specific due date, but let's try to release w/ Tizen 7.0 M2 (priority is lower than other established PLM/RELEASE tasks)
Plan A: use dlopen. get class instances of required tflite features.
Findings:
- Cannot use dlopen for getting tflite.so instance. It cannot be used for arbitrary tflite.so (need a "C" exported constructors and destructors of each tflite binary instance!)
- Plan A is inappropriate.
Plan B: let it be linked to "libtensorflow2-lite-custom.so" and user defines LD path in launch-time. This limits functionality a bit (cannot have multiple different custom tflite custom binaries for a given app.), but it will work. By default, let it try to load it from the "current" path of the app.
:octocat: cibot: Thank you for posting issue #3713. The person in charge will reply soon.
Plan B Issue: when libtensorflow-lite-custom.so is not available at the pipeline construction (tensor-filter loading), we need to generate proper (not killing the app) error!
#4268 will complete this.