pyk4a icon indicating copy to clipboard operation
pyk4a copied to clipboard

cap.color and cap.transformed_depth are not sync

Open visonpon opened this issue 1 year ago • 3 comments

Hi @etiennedub , after get the aligned rgb and depth, i tried to save them, but there exist sync problem between them, the depth seems always slow than rgb, but the saved rgb/depth videos have same frames rate and frames. Hope you can give can advice, thanks~

visonpon avatar Oct 27 '23 08:10 visonpon

Can you share the images and the script used to configure the device? They are supposed to be sync, unless you didn't configure it properly. Also since they are not using the same cameras, there is a slight difference.

lpasselin avatar Oct 27 '23 13:10 lpasselin

@visonpon Is there a fixed time offset between the RGB and depth frames? Or the time difference increase with the video duration? The former would be expected, but not the latter

etiennedub avatar Oct 27 '23 15:10 etiennedub

I set config like below 21

after overlap the dilated depth(processed as a mask ) to rgb, and you can see that in first frame the depth can overlap suitable, but in second frame the depth not in the proper position and lead to unnatural seg

11

visonpon avatar Oct 28 '23 03:10 visonpon