depthai-hardware icon indicating copy to clipboard operation
depthai-hardware copied to clipboard

PoE Close-In Depth Model - OAK-D-SR-PoE (D405 PoE)

Open Luxonis-Brandon opened this issue 2 years ago • 14 comments

Updates available in comments below

Start with the why:

PoE and IP67 sealed is a necessity in many robotic applications because of dirty, dusty, etc. environments and also because USB is often too fragile, finicky, or too short-distance for robotic-arm application. And M12 X-coded Ethernet is either a necessity or quite a nice to have.

So an IP67, M12 X-Coded version of the OAK D405 (https://github.com/luxonis/depthai-hardware/issues/241) would be enable use of such close-in depth in robotic applications in such environments.

Move to the how:

Leverage the OAK D405 USB version and the PoE circuitry, IP67 design, and M12 X-Coded + M8 IO connector design from OAK-D-Pro-PoE (shop, docs)

image

And implement this onto a smaller-form-factor commensurate with the narrower baseline like OAK-D-IoT-40 Series 2 (https://github.com/luxonis/depthai-hardware/issues/91; shown below)

image

Move to the what:

  • Dual OV9782 (1 MP Color Global Shutter) with production option for Wide FOV for 150° DFOV depth or Standard FOV for ~80°DFOV depth.
  • VGA (640x480 @ 30fps) ToF
  • PoE (M12 X-Coded; same as OAK-D-Pro-PoE)
  • 24V-compatible IO (same as OAK-D-Pro-PoE)

Luxonis-Brandon avatar Apr 22 '22 23:04 Luxonis-Brandon

@Luxonis-Brandon Hi Brandon - I am hoping you might have additional details on the FOV that the new OAK-D-SR-PoE camera (LR too). I have an area of 57" x 36" that I am looking to cover but I am constrained by the max height of the camera 14" to 16" above the area needing depth coverage. Is there any info or a 'simulated rendering' of the FOV based on this info that could be provided? What would be the max length and width for coverage for these new cameras? My email is [email protected] if would rather send there. Thank you.

alexivins avatar Nov 21 '22 17:11 alexivins

CC: @Luxonis-David

Hi @alexivins - I'll let David describe more of LR HW - but I think LR might be an appropriate choice, due to capability of swapping out lenses for custom ones, which should allow you to basically cover a wide range of different FOVs

themarpe avatar Nov 21 '22 22:11 themarpe

Sorry about the delay @alexivins

Yes with OAK-D-LR you can get 3-different baselines where shortest one would be 5cm and with the WFOV lenses you should cover the area pretty well although fisheye cold be used as well. WRT OAK-D-SR-PoE we are thinking that we would be offering two different types of camera modules with same FOVs that we do offer with our standard products. So one variant would come with the OV9782 and NFOV (FOV (D/H/V) 81°/69°/55°) lenses and second with OV9782 WFOV (FOV (D/H/V) 150°/127°/79.5°) lenses. How does that sound to you?

Luxonis-David avatar Nov 23 '22 12:11 Luxonis-David

@Luxonis-David, thank you for the info. from my understanding the fisheye impacts the accuracy of the depth and item detection. Would you happen to have a visual footprint of these? When would be the soonest I could get one (or both) of these cameras? I would like to begin testing real soon if possible. I appreciate your time and info.

alexivins avatar Nov 23 '22 16:11 alexivins

Yes that is right, with fisheye you get worse depth due to artifacts that are brought in. OAK-D-SR-PoE is still in process of development, lead time for first sample unknown most likely in early 2023. WRT OAK-D-LR we will be uploading the 3D CAD to the issue #247 tomorrow and you can refer to it, we should be starting shipping samples in a month or less, you should preorder to grant one here. Would OAK-D-SR be of an interest for testing? This one can be shipped in a week with 2x OV9782 NFOV.

Luxonis-David avatar Nov 23 '22 19:11 Luxonis-David

Hello @Luxonis-David @Luxonis-Brandon Is there any chance you could provide the following info for the OAK-D-LR and SR PoE versions. Also if you have for OAK-D-W. Camera FOV_AOC.pdf Info in this format would be very helpful. Thank you in advance.

alexivins avatar Dec 01 '22 17:12 alexivins

@alexivins we will be looking into this and let you know once we can have it. It would make sense that we also integrate this into our docs. CC: @Erol444

Luxonis-David avatar Dec 02 '22 07:12 Luxonis-David

Quick update on the project Luxonis is actively working on the project finalizing the design for the main board with 2x OV9782/)282 color/grayscale camera sensors and ToF module. Product will in one of its variants also support active illumination including IR dot projector and Flood LED. Product is based on OAK-SoM-Pro and would later on also feature OAK-SoM-Pro-S3. Separate board for M12 and M8 connector was designed in order to enhance mechanical properties and make the product more compact. Pasting few renders below for visibility on the progress, design is not final yet but expected to be completed in the beginning of the March and sent for fabrication. image image image

Luxonis-David avatar Feb 24 '23 18:02 Luxonis-David

Hi, very interesting product! I have a question: when using with OV9782 WFOV module, what would be the estimated min and max distances that the cam could cover?

bochen87 avatar Apr 14 '23 08:04 bochen87

Hi @bochen87 , If you mean the recommended min/max stereo depth perception, I'd estimate it would be from 20cm to about 80cm-100cm for the stereo, and about 3m for tof (max depth perception for tof is 5m though). Thoughts?

Erol444 avatar Apr 14 '23 14:04 Erol444

Hi, very interesting product for eye-in-hand applications! Can you share the dimensions of the current design? How will the TOF and stereo data be combined, or do you get 2 depth streams? And what is the minimum distance for the TOF sensor?

ToonTielen avatar May 16 '23 12:05 ToonTielen

Hi @ToonTielen,

Dimensions of the enclosure(x,y,z): 7.9 x 5.2 x 4.5 cm image

Minimum working distance for the ToF sensors is 29cm. @Erol444 would you know plans on combining the stereo+ToF depth map?

Luxonis-David avatar May 17 '23 05:05 Luxonis-David

Hi @ToonTielen , we do plan to add fusing of ToF + Stereo, but aligning ToF to camera is the priority. We haven't yet added either of these 2 features.

Erol444 avatar May 17 '23 09:05 Erol444

Docs here: https://docs.luxonis.com/projects/hardware/en/latest/pages/OAK-D-SR-POE.html

Erol444 avatar May 20 '23 11:05 Erol444