depthai-python icon indicating copy to clipboard operation
depthai-python copied to clipboard

OAK-D SR PoE - Tinted RGB images and ToF Depth alignment

Open ozgucbertug opened this issue 1 year ago • 7 comments

Hello all,

I've gotten to experiment with the OAK-D SR PoE camera recently and have run into a bit of an issue that I'm hoping someone might be able to assist with.

I've first tested this device with a known-working script used with an OAK-D SR camera and later using utilities/cam_test.py script separately and I'm observing what I'd describe as a "tinted monochrome" appearance on both left and right (CAM_B and CAM_C sockets). So far, I've tested it with both RGB and BGR color order and unfortunately this hasn't resolved the issue. You can see the results below. I am not entirely sure if I'm missing something in the camera settings or the problem lies somewhere else. Any advice would be greatly appreciated.

image

Additionally, I've ben looking for resources that can guide me on aligning images from ToF camera frame to the RGB frame. If there's a development branch you could point me towards, it would be greatly appreciated.

Thank you in advance for your time and any help that you can provide. I'm very excited about this camera and am looking forward to resolving these issues.

ozgucbertug avatar Jul 05 '23 23:07 ozgucbertug

Hi @ozgucbertug , Initial OAK-D-SR-POE cameras are monochorme, not color, that's why there's purple tint (mentioned in shop page). We apologize for the inconvenience. Regarding ToF alignment with camera frames, it should be available in the coming weeks, cc @AndrejSusnik .

Erol444 avatar Jul 07 '23 11:07 Erol444

Hey @Erol444, Thank you for your reply. I'm happy to know this is the intended behavior and should be able to work around the limitations for the time being.

@AndrejSusnik - do you have any timeline for when the alignment will be implemented for the ToF node? Also I'd really appreciate if you can point me to a dev branch where I can follow the changes for ToF/SR PoE related changes.

ozgucbertug avatar Jul 07 '23 18:07 ozgucbertug

@ozgucbertug The alignment will not be a part of ToF node but another general depth alignment node, at least as a part of my current task. I will let you know when there will be available version for you to test

AndrejSusnik avatar Jul 12 '23 10:07 AndrejSusnik

@ozgucbertug Did you manage to get the ToF working? Where did you get this camera from? We, like many others, have preordered the camera more than 6 months ago and are still waiting on it, while Luxonis continuously postpones their delivery promises. Anyone reading this especially if you are planning on using this within a reasonable timeframe: be warned about production issues, false claims, and incorrect delivery promises.

mindThomas avatar Jan 03 '24 14:01 mindThomas

Hi @mindThomas

Sorry for the delays and issues with our upcoming SR PoE device, adding in support for ToF imager. We have opened up the device as part of our early access to enable "preview" into both early development as well as hardware access. Unfortunately, due to tackling the new ToF capabilites as well as overcoming some HW related issues, we are still not ready yet for a complete rollout.

I update the thread as we progress through the aforementioned issues.

themarpe avatar Jan 05 '24 10:01 themarpe

Hi @AndrejSusnik is there any update on when a generic depth alignment node will be available?

adamwhats avatar Apr 24 '24 10:04 adamwhats

@adamwhats

Will be part of v2.26.0 - we have a correct impl. on host now, and just has to be ported to FW as well image image

themarpe avatar Apr 24 '24 12:04 themarpe