dabnn icon indicating copy to clipboard operation
dabnn copied to clipboard

Benchmark guide

Open Bil17t opened this issue 4 years ago • 5 comments

First, congrats on such a successful framework! I would like to test the speed of daBNN on my platform. I can see the benchmark utility, but does it include actual inference on imagenet pictures? Any more detailed instruction?

Bil17t avatar Oct 17 '19 14:10 Bil17t

Thanks for your attention!

You might want to check out https://github.com/JDAI-CV/dabnn-example . I'll also add some detailed document soon.

On Thu, Oct 17, 2019, 10:56 PM Bil17t [email protected] wrote:

First, congrats on such a successful framework! I would like to test the speed of daBNN on my platform. I can see the benchmark utility, but does it include actual inference on imagenet pictures? Any more detailed instruction?

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/JDAI-CV/dabnn/issues/62?email_source=notifications&email_token=ACYRZH57JOACKFETACHJ7BTQPB4LLA5CNFSM4JB24ZN2YY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4HSPT4EA, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACYRZHZMQZWCT4H6WERAQJTQPB4LLANCNFSM4JB24ZNQ .

daquexian avatar Oct 17 '19 15:10 daquexian

Which do you want to do, benchmark some models on your side, or do actual inference? Thanks!

daquexian avatar Oct 18 '19 02:10 daquexian

I have tested the speed. It would be better if we can verify the accuracy as well. It will also be easier to deploy other models.

Bil17t avatar Oct 18 '19 12:10 Bil17t

For verifying the accuracy, I think you can modify the code based on https://github.com/JDAI-CV/dabnn-example and check the output currently.

daquexian avatar Oct 21 '19 08:10 daquexian

And if you want to verify the accuracy more carefully, you can check out 'binaries/run.cpp' about how to send a given input tensor to the model and retrieve the output.

daquexian avatar Oct 21 '19 09:10 daquexian