Manifold-Cam icon indicating copy to clipboard operation
Manifold-Cam copied to clipboard

Possible on NVIDIA Jetson TK1 (very close to manifold)?

Open Shikhargupta opened this issue 8 years ago • 18 comments

'A Nvidia provided decoding chip is necessary together with a .so library, which is also from Nvidia. And the cable/port is specially designed.'

Jetson has the decoding chip and .so library but lacks in port. Is there any way to get it work using GPIO or anything else?

Shikhargupta avatar Jun 18 '16 08:06 Shikhargupta

yes but sorry I cannot tell you :( It's confidential

lanyusea avatar Jun 18 '16 14:06 lanyusea

Found it. :)

Shikhargupta avatar Jun 18 '16 14:06 Shikhargupta

Could you connect the DJI camera into NVIDIA Jetson TK1 and successfully catch frame data from the TK1 board real-time? Please teach me thanks.

apollo-time avatar Jun 22 '16 03:06 apollo-time

Can I draw output some custom information such as detected face rectangle on the camera frame with the manifold?

apollo-time avatar Jun 22 '16 03:06 apollo-time

yes you can, with Manifold.

lanyusea avatar Jun 22 '16 03:06 lanyusea

How can I it? Please teach me.

apollo-time avatar Jun 22 '16 03:06 apollo-time

check the code in this repo for reading video streams check opencv tutorial for face detection and drawing rectangle

lanyusea avatar Jun 22 '16 03:06 lanyusea

I found the manifold_cam_read api, but can't found the manifold_cam_write. Which buffer I can draw output on?

apollo-time avatar Jun 22 '16 03:06 apollo-time

You may need to try Mobile SDK if you want to display in on the DJI GO of you Mobile device.

The Manifold only has decoding module to decode the video buffer received from the drone, but has not encoding module to encode video and send it to your mobile.

lanyusea avatar Jun 22 '16 04:06 lanyusea

I can detect face on the Manifold with camera frame real-time. Now how can receive the face detection result from manifold on the Mobile SDK? Can I send the meta data such as face position from Manifold to mobile device via wireless?

apollo-time avatar Jun 22 '16 04:06 apollo-time

I mean you can do the detection and drawing on Mobile SDK directly.

If you want to transmit the result from Manifold to Mobile device, you can use Data Transparent Transmission.

lanyusea avatar Jun 22 '16 04:06 lanyusea

Wouldn't it be difficult to transmit an image using Data Transparent Transmission, having to break it up into 100 Byte packets?

maxsmo3 avatar Jun 22 '16 04:06 maxsmo3

yes difficult. so you can just send the result

lanyusea avatar Jun 22 '16 04:06 lanyusea

How can I capture the camera frame real-time on my mobile device or windows PC? And what is max frame resolution with streaming on client? Is support RTSP protocol the camera on the drone?

apollo-time avatar Jun 22 '16 05:06 apollo-time

there are some APIs in DJI Mobile SDK to help you get the real-time video buffer

lanyusea avatar Jun 22 '16 05:06 lanyusea

@Shikhargupta did you ever manage to get the camera image in OpenCV using an alternative computer? I'm trying to use the Jetson TX2 with a Zenmuse X3 camera onboard a M100

CWOA avatar May 17 '18 16:05 CWOA

@CWOA No, I couldn't.

Shikhargupta avatar May 17 '18 20:05 Shikhargupta

'A Nvidia provided decoding chip is necessary together with a .so library, which is also from Nvidia. And the cable/port is specially designed.'

Jetson has the decoding chip and .so library but lacks in port. Is there any way to get it work using GPIO or anything else?

Do you have a solution? I need your advice

zhuangxinfa avatar May 31 '20 02:05 zhuangxinfa