acap-computer-vision-sdk-examples icon indicating copy to clipboard operation
acap-computer-vision-sdk-examples copied to clipboard

Published 20 hours ago • verified publisher icon AxisCommunications

Spike in inference time from the inference server

Open akash-syook opened this issue 1 year ago • 2 comments

Please do not disclose security vulnerabilities as issues. See our security policy for responsible disclosures.

I have trained yolov5m model and sucessfully deployed on Axis "AXIS M4317-PLR Panoramic Camera".

The avg inference time is 70-80 ms but sometimes there is a spike in inference time from inference server. I am using below repo for my custom trained yolov5 model https://github.com/AxisCommunications/axis-model-zoo/blob/main/docs/yolov5-on-artpec8.md For deployment I have used https://github.com/AxisCommunications/acap-computer-vision-sdk-examples/tree/main/object-detector-python

Added sample screenshots. Please let me know what could be wrong. Screenshot from 2024-08-21 17-06-50 Screenshot from 2024-08-21 17-08-12

Explain the behavior you would expect and the actual behavior.

To reproduce

Please provide as much context as possible and describe the reproduction steps that someone else can follow to recreate the issue on their own.

A team member will try to reproduce the issue with your provided steps. If there are no reproduction steps or no obvious way to reproduce the issue, the team will ask you for those steps. Bugs without steps will not be addressed until they can be reproduced.

Steps to reproduce the behavior:

  1. Set up '...'
  2. Do this '...'
  3. See error

Screenshots

If applicable, add screenshots to help explain your problem.

Environment

  • Axis device model: [e.g. Q1615 Mk III]
  • Axis device firmware version: [e.g. 10.5]
  • Stack trace or logs: [e.g. Axis device system logs]
  • OS and version: [e.g. macOS v12.2.1, Ubuntu 20.04 LTS, Windows build 21996.1]
  • Version: [version of the application, SDK, runtime environment, package manager, interpreter, compiler, depending on what seems relevant]

Additional context

Add any other context about the problem here.

akash-syook avatar Aug 21 '24 11:08 akash-syook

HI @akash-syook I will transfer this issue to the example repository

Corallo avatar Aug 21 '24 12:08 Corallo

Hi @akash-syook , what version of AXIS OS and ACAP Runtime are you using? It looks like it's the template values for the Environment in your question.

pataxis avatar Sep 19 '24 12:09 pataxis

Axis os: 11.11.73 ACAP Runtime: 1.3.1 Let me know if you need any inputs.

akash-syook avatar Sep 27 '24 12:09 akash-syook

Hi @akash-syook We could unfortunately not replicate the issue.

Stiv-work avatar Nov 01 '24 12:11 Stiv-work