chunseoklee

> On stm32f767 216MHz with external SDRAM person detection: tflite micro: Finished in 6747161us luci: Finished in 4766142us This is a bit interesting. We're still better even with tf-micro's new...

@SlavikMIPT @binarman @BalyshevArtem Could you please help to measure the result like https://github.com/Samsung/ONE/issues/7598#issuecomment-1042640533 for new arrived internal models ? We tried to do it by ourselves, but we did not...

> @chunseoklee Can we use python notebooks with the internal models which @lemmaa provided with me yesterday or you already have converted to tf-micro models? If so, could share them...

@lucenticus Note that the model by https://github.com/Samsung/ONE/issues/7598#issuecomment-1082816468 might have non -static input shape.

Q. What is the functionality that ONE's users(developer) expect from nnfw api(including config file) ? - (allow users to) enable/disable On-Device Compilation(ODC) in app - (allow users to) choose the...

- Successful Workflow ```mermaid flowchart TD subgraph "nnpkg" n1(F32 circle) end subgraph "nnpkg2" n2(Quantized circle) end subgraph "nnpkg3" n3(tvn) end nnpkg-->|1. collect rep. data|nnpkg-->| 2. ondevice quantization|nnpkg2 -->|3. ondevice compilation|nnpkg3...

Conclusion on offline discussion - Let's minimize user level API + enable ODC via config file. Thus, disable ODC w/o this flag.

Here is a user scenario plus ONE's internal workflow in detail with quantized circle : 0. Assumption A1. model.q8.circle is compilable circle with (trix-compatible) q8 quantized 1. User's app implement...

Apple is on-device compiling in iOS ? : https://developer.apple.com/documentation/coreml/mlmodel/3931181-compilemodel Need to investigate more

[MLModel.CompileModel(NSUrl, NSError) Method (CoreML) | Microsoft Docs](https://docs.microsoft.com/en-us/dotnet/api/CoreML.MLModel.CompileModel?view=xamarin-ios-sdk-12) gives more info that Apple :)