mace icon indicating copy to clipboard operation
mace copied to clipboard

where are benchmark results being saved?

Open umairjavaid opened this issue 2 years ago • 1 comments

I have downloaded the latest docker image. I can't find the model benchmark results. model = resnet50-v2 command for benchmark

python tools/converter.py run --config=mace-models/resnet-v2-50/resnet-v2-50.yml --benchmark --debug_mode --report

CMD> bazel build //mace/proto:mace_py
WARNING: --batch mode is deprecated. Please instead explicitly shut down your Bazel server using the command "bazel shutdown".
Loading:
Loading: 0 packages loaded
Analyzing: target //mace/proto:mace_py (17 packages loaded)
INFO: Analysed target //mace/proto:mace_py (17 packages loaded).
INFO: Found 1 target...
[0 / 4] [-----] BazelWorkspaceStatusAction stable-status.txt
Target //mace/proto:mace_py up-to-date:
bazel-genfiles/mace/proto/mace_pb2.py
INFO: Elapsed time: 1.542s, Critical Path: 0.03s
INFO: 0 processes.
INFO: Build completed successfully, 1 total action
INFO: Build completed successfully, 1 total action

CMD> cp -f bazel-genfiles/mace/proto/mace_pb2.py /home/umair/Desktop/umair/mace/tools/python/py_proto

CMD> bazel build //mace/proto:micro_mem_py
WARNING: --batch mode is deprecated. Please instead explicitly shut down your Bazel server using the command "bazel shutdown".
Loading:
Loading: 0 packages loaded
Analyzing: target //mace/proto:micro_mem_py (16 packages loaded)
INFO: Analysed target //mace/proto:micro_mem_py (17 packages loaded).
INFO: Found 1 target...
[0 / 21] [-----] BazelWorkspaceStatusAction stable-status.txt
Target //mace/proto:micro_mem_py up-to-date:
bazel-genfiles/mace/proto/micro_mem_pb2.py
INFO: Elapsed time: 1.514s, Critical Path: 0.03s
INFO: 0 processes.
INFO: Build completed successfully, 1 total action
INFO: Build completed successfully, 1 total action

CMD> cp -f bazel-genfiles/mace/proto/micro_mem_pb2.py /home/umair/Desktop/umair/mace/tools/python/py_proto

CMD> bazel build //third_party/caffe:caffe_py
WARNING: --batch mode is deprecated. Please instead explicitly shut down your Bazel server using the command "bazel shutdown".
Loading:
Loading: 0 packages loaded
INFO: Analysed target //third_party/caffe:caffe_py (17 packages loaded).
Building: no action
INFO: Found 1 target...
[2 / 24] [-----] BazelWorkspaceStatusAction stable-status.txt
Target //third_party/caffe:caffe_py up-to-date:
bazel-genfiles/third_party/caffe/caffe_pb2.py
INFO: Elapsed time: 1.585s, Critical Path: 0.04s
INFO: 0 processes.
INFO: Build completed successfully, 1 total action
INFO: Build completed successfully, 1 total action

CMD> cp -f bazel-genfiles/third_party/caffe/caffe_pb2.py /home/umair/Desktop/umair/mace/tools/python/py_proto

CMD> bazel build //mace/proto:mace_py
WARNING: --batch mode is deprecated. Please instead explicitly shut down your Bazel server using the command "bazel shutdown".
Loading:
Loading: 0 packages loaded
Analyzing: target //mace/proto:mace_py (12 packages loaded)
INFO: Analysed target //mace/proto:mace_py (17 packages loaded).
INFO: Found 1 target...
[0 / 4] [-----] BazelWorkspaceStatusAction stable-status.txt
Target //mace/proto:mace_py up-to-date:
bazel-genfiles/mace/proto/mace_pb2.py
INFO: Elapsed time: 1.596s, Critical Path: 0.05s
INFO: 0 processes.
INFO: Build completed successfully, 1 total action
INFO: Build completed successfully, 1 total action

CMD> cp -f bazel-genfiles/mace/proto/mace_pb2.py tools/python/py_proto

CMD> bazel build //mace/proto:micro_mem_py
WARNING: --batch mode is deprecated. Please instead explicitly shut down your Bazel server using the command "bazel shutdown".
Loading:
Loading: 0 packages loaded
Analyzing: target //mace/proto:micro_mem_py (12 packages loaded)
INFO: Analysed target //mace/proto:micro_mem_py (17 packages loaded).
INFO: Found 1 target...
[0 / 7] [-----] BazelWorkspaceStatusAction stable-status.txt
Target //mace/proto:micro_mem_py up-to-date:
bazel-genfiles/mace/proto/micro_mem_pb2.py
INFO: Elapsed time: 1.616s, Critical Path: 0.05s
INFO: 0 processes.
INFO: Build completed successfully, 1 total action
INFO: Build completed successfully, 1 total action

CMD> cp -f bazel-genfiles/mace/proto/micro_mem_pb2.py tools/python/py_proto

CMD> bazel build //third_party/caffe:caffe_py
WARNING: --batch mode is deprecated. Please instead explicitly shut down your Bazel server using the command "bazel shutdown".
Loading:
Loading: 0 packages loaded
Analyzing: target //third_party/caffe:caffe_py (12 packages loaded)
INFO: Analysed target //third_party/caffe:caffe_py (17 packages loaded).
INFO: Found 1 target...
[0 / 7] [-----] BazelWorkspaceStatusAction stable-status.txt
Target //third_party/caffe:caffe_py up-to-date:
bazel-genfiles/third_party/caffe/caffe_pb2.py
INFO: Elapsed time: 1.552s, Critical Path: 0.04s
INFO: 0 processes.
INFO: Build completed successfully, 1 total action
INFO: Build completed successfully, 1 total action

CMD> cp -f bazel-genfiles/third_party/caffe/caffe_pb2.py tools/python/py_proto

* Package libs for resnet-v2-50
Start packaging 'resnet-v2-50' libs into build/resnet-v2-50/libmace_resnet-v2-50.tar.gz
build/resnet-v2-50/include/
build/resnet-v2-50/include/mace/
build/resnet-v2-50/include/mace/public/
build/resnet-v2-50/include/mace/public/mace_engine_factory.h
build/resnet-v2-50/include/mace/public/resnet_v2_50.h
build/resnet-v2-50/build/
build/resnet-v2-50/build/resnet-v2-50/
build/resnet-v2-50/build/resnet-v2-50/include/
build/resnet-v2-50/build/resnet-v2-50/include/mace/
build/resnet-v2-50/build/resnet-v2-50/include/mace/public/
build/resnet-v2-50/build/resnet-v2-50/include/mace/public/mace_engine_factory.h
build/resnet-v2-50/build/resnet-v2-50/include/mace/public/resnet_v2_50.h
build/resnet-v2-50/build/resnet-v2-50/model/
build/resnet-v2-50/build/resnet-v2-50/model/arm64-v8a/
build/resnet-v2-50/build/resnet-v2-50/model/arm64-v8a/resnet-v2-50.a
build/resnet-v2-50/build/resnet-v2-50/model/armeabi-v7a/
build/resnet-v2-50/build/resnet-v2-50/model/armeabi-v7a/resnet-v2-50.a
build/resnet-v2-50/build/resnet-v2-50/model/resnet_v2_50.data
build/resnet-v2-50/model/
build/resnet-v2-50/model/arm64-v8a/
build/resnet-v2-50/model/arm64-v8a/resnet-v2-50.a
build/resnet-v2-50/model/armeabi-v7a/
build/resnet-v2-50/model/armeabi-v7a/resnet-v2-50.a
build/resnet-v2-50/model/resnet_v2_50.data
Packaging Done!

--------------------------------------------------------------------------
                                 Library                                  
--------------------------------------------------------------------------
|          key           |                     value                     |
==========================================================================
| MACE Model package Path| build/resnet-v2-50/libmace_resnet-v2-50.tar.gz|
--------------------------------------------------------------------------
```
`
------------------------

### System information
- **LINUX 18.04 (e.g., Linux Ubuntu 16.04)**:
- **MACE 1.1.1 (Use the command: git describe --long --tags)**:
- **Python version(2.7)**: 
- **Bazel version (e.g., 0.13.0)**:

### Model deploy file (*resnet50.yml)
```yaml
......
```

umairjavaid avatar Feb 10 '22 11:02 umairjavaid

The benchmark did not start for MACE can not find mobile device whose abi was specified in the yml file

lu229 avatar Mar 29 '22 06:03 lu229