zed-ros-wrapper icon indicating copy to clipboard operation
zed-ros-wrapper copied to clipboard

Problem with auto-exposure while streaming data in local network

Open leon2225 opened this issue 2 years ago • 8 comments

Preliminary Checks

  • [X] This issue is not a duplicate. Before opening a new issue, please search existing issues.
  • [X] This issue is not a question, feature request, or anything other than a bug report directly related to this project.

Description

Hey, we are currently working on a project including the ZED2-Camera for an autnomous navigation drone. Because the Companion Computer (Jetson Xavier) is not capable of running RTAB-Map on its own, your RTAP-Map example is running on a desktop computer. The drone is then streaming the video+imu data via WiFi using the streaming capabilities of the ZED-SDK.

The problem is, that the auto-exposure control seems not to work correctly in this setting. We tried to do the streaming out of the zed-ros-wrapper with auto-exposure configured in the common.yaml launch settings. Also we did the streaming via the python api where we did activate the auto-exposure as well. In addition we also eneabled the auto-exposure on the receiveing end (i.e. on the desktop computer).

Non of the above steps seems to activate the auto-exposure. Is this some kind of bug or did we miss the right place to configure this?

Steps to Reproduce

  1. Launch zed2 on remote machine
  2. start stream service
  3. Launch rtab-map example with stream arg set

Expected Result

Working auto-exposure

Actual Result

auto-exposure not working

ZED Camera model

ZED2

Environment

OS: Ubuntu 20.04 | Ubuntu 20.04
CPU: Ryzen 7 5800x | Jetson Xavier
GPU: GeForce GTX 1070 | Jetson Xavier
SDK: 3.7.2 | 3.7.2 
ROS: Noetic | Noetic

Anything else?

Greetings from Germany

leon2225 avatar May 06 '22 12:05 leon2225

Hi @leon2225 the auto exposure setting should be automatically enabled when the ZED SDK opens the camera. We are going to check the behavior that you describe and eventually fix it

Myzhar avatar May 06 '22 12:05 Myzhar

Hey @Myzhar, yes, that's what we thought as well. We've made a video of the current behavior, hopefully this will help you to fix the issue: https://www.youtube.com/watch?v=nb9kGws8H2A The description is in German, but that shouldn't be too relevant for this purpose.

leon2225 avatar May 10 '22 08:05 leon2225

Hey @Myzhar, is there an update yet?

BTW what would be the right device to configure the camera? Would that be the streaming or the receiving device?

leon2225 avatar May 12 '22 18:05 leon2225

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment otherwise it will be automatically closed in 5 days

github-actions[bot] avatar Jun 12 '22 02:06 github-actions[bot]

Hey @Myzhar, the auto-exposure feature is critical for our project at the University of Applied Sciences in Fulda, Germany. As of now, the project is stalling due to this issue. Can you give us any update regarding your internal checks or the final fix?

leon2225 avatar Jun 13 '22 09:06 leon2225

Hi @leon2225 We could not replicate this issue in the past, but we are going to investigate it further.

Myzhar avatar Jun 13 '22 10:06 Myzhar

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment otherwise it will be automatically closed in 5 days

github-actions[bot] avatar Jul 14 '22 02:07 github-actions[bot]

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment otherwise it will be automatically closed in 5 days

github-actions[bot] avatar Aug 15 '22 02:08 github-actions[bot]

Hi @leon2225 @Myzhar,

I am facing the same issue. I'm using ZED SDK 3.7, record through ZED_Explorer in ubuntu18. Is there any update or solution on this issue?

darissa avatar Aug 18 '22 06:08 darissa

We have identified a bug when controlling the camera settings (exposure, gamma, gain...) when using the streaming mode. When the sender has a grab recovery, the receiver lost the ability to control the sender camera settings. This will be fixed in next patch

obraun-sl avatar Aug 18 '22 06:08 obraun-sl

Hey, Do you already know when this Patch ist going to be launched?

leon2225 avatar Sep 06 '22 10:09 leon2225

We are testing all the behaviors of the next ZED SDK patch, it will be released soon.

Myzhar avatar Sep 06 '22 11:09 Myzhar

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment otherwise it will be automatically closed in 5 days

github-actions[bot] avatar Oct 07 '22 02:10 github-actions[bot]