Where is this function "hexagon_nn_remove_clocks " implemented? Thanks

[mccoychang]

Where is this function "hexagon_nn_remove_clocks " implemented? Thanks

[lee-bin]

I just synced this repo, you can find it from here.

[mccoychang]

Hi BIN,

Thank you very much . But the following command still has some problems.

Then I copy the file "hexagon_nn.h" to "mace / third_party / nnlib / hexagon_nn.h", and run the command "bash tools / bazel-build-standalone-lib.sh" (only build shared lib for arm64-v8a + cpu_gpu_dsp), and get the following error message:

In file included from mace/core/runtime/hexagon/hexagon_dsp_wrapper.cc:31: ./third_party/nnlib/hexagon_nn.h:3:10: fatal error: 'AEEStdDef.h' file not found #include <AEEStdDef.h> ^~~~~~~~~~~~~ 1 error generated. Target //mace/libmace:libmace_dynamic failed to build INFO: Elapsed time: 140.187s, Critical Path: 18.87s INFO: 63 processes: 63 local. FAILED: Build did NOT complete successfully

Regards.

[lee-bin]

Don't replace the file hexagon_nn.h.

[mccoychang]

Hi BIN,

Run the example "mobilenet-v1-quantize-retrain-dsp" on target_socs: [sdm845], get the following error message:

2020-02-17 23:16:25.583 12455-12505/? I/MACE: mace.cc:500 Creating MaceEngine, MACE version: v0.12.0-20-gd7533c4 2020-02-17 23:16:25.583 12455-12505/? I/MACE: mace.cc:539 Initializing MaceEngine 2020-02-17 23:16:25.585 12455-12505/? W/MACE: hexagon_dsp_wrapper.cc:147 Hexagon set power failed: -1 2020-02-17 23:16:25.585 12455-12505/? A/MACE: hexagon_dsp_wrapper.cc:127 Check failed: hexagon_nn_version(&version) == 0 get version error 2020-02-17 23:16:25.588 12455-12505/? A/MACE: hexagon_dsp_wrapper.cc:127 backtrace: 2020-02-17 23:16:25.588 12455-12505/? A/MACE: hexagon_dsp_wrapper.cc:127 pc 0x78ed021938 _ZN4mace4port10AndroidEnv18GetBackTraceUnsafeEi

Thanks, regards.

[lee-bin]

You can check if your device supports running models on DSP, please refer to Supported devices.

[mccoychang]

But use nnlib/android_Release/ship/controller_test to test :

adb shell "LD_LIBRARY_PATH=/data/local/tmp/hexagon_nn64 /data/local/tmp/hexagon_nn64/controller_test" HexagonNN version: 0x20600 Success!

[lee-bin]

The current version is 0x20f00, so it's not supposed to be 0x20600. Did you push the libhexagon_nn_skel.so?

[mccoychang]

OK, re-push libhexagon_nn_skel.so, adb shell "LD_LIBRARY_PATH=/data/local/tmp/hexagon_nn64 /data/local/tmp/hexagon_nn64/controller_test" HexagonNN version: 0x20f00 Success!

But still get the same error message:

02-17 17:53:58.825 344 577 I MACE : mace.cc:500 Creating MaceEngine, MACE version: v0.12.0-20-gd7533c4 02-17 17:53:58.826 344 577 I MACE : mace.cc:539 Initializing MaceEngine 02-17 17:53:58.826 344 577 W MACE : hexagon_dsp_wrapper.cc:147 Hexagon set power failed: -1 02-17 17:53:58.827 344 577 F MACE : hexagon_dsp_wrapper.cc:127 Check failed: hexagon_nn_version(&version) == 0 get version error

[lee-bin]

Please paste the log of: adb logcat

[mccoychang]

about model :

library_name: mobilenet-v1-quantize-retrain-dsp target_abis: [arm64-v8a] target_socs: [sdm845] model_graph_format: code model_data_format: code models: mobilenet_v1_quantize_retrain: platform: tensorflow model_file_path: http://cnbj1.fds.api.xiaomi.com/mace/miai-models/mobilenet-v1/mobilenet_v1_1.0_224_quant_retrain.pb model_sha256_checksum: c3faa9bd790310eb3dec411d2f2e2dd8802394e31ccb47daaa5e3b6369fadfa3 subgraphs: - input_tensors: - input input_shapes: - 1,224,224,3 input_ranges: - -1.0,1.0 output_tensors: - MobilenetV1/Predictions/Softmax:0 output_shapes: - 1,1001 check_tensors: - MobilenetV1/Logits/Conv2d_1c_1x1/BiasAdd:0 check_shapes: - 1,1,1,1001 validation_inputs_data: - http://cnbj1.fds.api.xiaomi.com/mace/miai-models/mobilenet-v1/input_n01440764_15071.JPEG_input runtime: dsp limit_opencl_kernel_time: 0 nnlib_graph_mode: 0 obfuscate: 0 winograd: 0 quantize: 1

in the code "image_classify.cc" std::map<std::string, ModelInfo> model_infos = { {"mobilenet_v1_quantize_retrain", {"input", "MobilenetV1/Predictions/Softmax:0", {1, 224, 224, 3}, {1,1001}}},

and got the error message :

02-18 12:37:30.456 28155 28181 I MACE : mace.cc:500 Creating MaceEngine, MACE version: v0.12.0-20-gd7533c4 02-18 12:37:30.457 28155 28181 I MACE : mace.cc:539 Initializing MaceEngine 02-18 12:37:30.457 28155 28181 F MACE : mace.cc:577 'MobilenetV1/Predictions/Softmax:0' does not belong to model's outputs [MobilenetV1/Logits/Conv2d_1c_1x1/BiasAdd:0] 02-18 12:37:30.458 28155 28181 F MACE : mace.cc:577 backtrace: 02-18 12:37:30.458 28155 28181 F MACE : mace.cc:577 pc 0x7ae8bd0b58 _ZN4mace4port10AndroidEnv18GetBackTraceUnsafeEi 02-18 12:37:30.458 28155 28181 F MACE : mace.cc:577 pc 0x7ae8bd4018 _ZN4mace4port6Logger13DealWithFatalEv

If modify the code "image_classify.cc" : std::map<std::string, ModelInfo> model_infos = { {"mobilenet_v1_quantize_retrain", {"input", "MobilenetV1/Logits/Conv2d_1c_1x1/BiasAdd:0", {1, 224, 224, 3}, {1,1,1, 1001}}},

error message:

02-18 14:48:30.501 13316 13341 I MACE : mace.cc:539 Initializing MaceEngine 02-18 14:48:30.502 13316 13341 E adsprpc : remote.c:25:Invoking stubbed routine - Return failure 02-18 14:48:30.502 13316 13341 E adsprpc : remote.c:30:Invoking stubbed routine - Return failure 02-18 14:48:30.502 13316 13341 W MACE : hexagon_dsp_wrapper.cc:147 Hexagon set power failed: -1 02-18 14:48:30.502 13316 13341 E adsprpc : remote.c:25:Invoking stubbed routine - Return failure 02-18 14:48:30.502 13316 13341 E adsprpc : remote.c:30:Invoking stubbed routine - Return failure 02-18 14:48:30.502 13316 13341 F MACE : hexagon_dsp_wrapper.cc:127 Check failed: hexagon_nn_version(&version) == 0 get version error 02-18 14:48:30.503 13316 13341 F MACE : hexagon_dsp_wrapper.cc:127 backtrace: 02-18 14:48:30.503 13316 13341 F MACE : hexagon_dsp_wrapper.cc:127 pc 0x7ae929ab58 _ZN4mace4port10AndroidEnv18GetBackTraceUnsafeEi 02-18 14:48:30.503 13316 13341 F MACE : hexagon_dsp_wrapper.cc:127 pc 0x7ae929e018 _ZN4mace4port6Logger13DealWithFatalEv 02-18 14:48:30.503 13316 13341 F MACE : hexagon_dsp_wrapper.cc:127 pc 0x7ae929dfa8 _ZN4mace4port6Logger18GenerateLogMessageEv 02-18 14:48:30.503 13316 13341 F MACE : hexagon_dsp_wrapper.cc:127 pc 0x7ae929e37c _ZN4mace4port6LoggerD2Ev 02-18 14:48:30.503 13316 13341 F MACE : hexagon_dsp_wrapper.cc:127 pc 0x7ae929e508 _ZN4mace4port6LoggerD1Ev

[mccoychang]

My doubt is that model's outputs should be "MobilenetV1/Predictions/Softmax:0", but got error.

[lee-bin]

The outputs used in "image_classify.cc" should be "MobilenetV1/Logits/Conv2d_1c_1x1/BiasAdd:0" as Hexagon NN does not support Op Squeeze which is just front of Softmax.

As for the adb log, please provide the full log from MACE start instead of just a piece.

[mccoychang]

OK, the attach file is the mace log.
log1206.txt

[mccoychang]

Hi BIN,

Remove the library "libcdsprpc.so" and succeed.

log1206_no_cdsprpc.txt

[lee-bin]

Did you push "libcdsprpc.so" to your phone before? Where did you remove it from?

[mccoychang]

In the folder "macelibrary / src / main / jniLibs / arm64-v8a", Refer to https://github.com/XiaoMi/mace/tree/master/third_party/nnlib/arm64-v8a. Originally put libcdsprpc.so and then deleted.

[lee-bin]

OK, libcdsprpc.so is only used to build libmace and should not be used later, as every device which supports Hexagon DSP is shipped with a libcdsprpc.so. I'll try to clarify that.