predictive-filter-flow icon indicating copy to clipboard operation
predictive-filter-flow copied to clipboard

Code for pose tracking in mgPFF paper

Open zlai0 opened this issue 5 years ago • 4 comments

Hi, do you have the code for pose tracking? I wonder how exactly do you encode the 15 keypoints as 15 maps?

zlai0 avatar Apr 24 '19 17:04 zlai0

Hi,

Thanks for your interest. I would release that after our submission becomes accepted. But here is how we did that --

  1. prepare 15 maps for 15 keypoints respectively.
  2. for each map, I dilate the corresponding joint to make it bigger in size, thus allowing for flowing; otherwise it would diminish.
  3. using the PFF to propagate the 15 maps, forming a new stack of 15 maps.
  4. for each map, voting for the new location of the joint.

Hope this helps understand the workflow.

Regards, Shu

On Wed, Apr 24, 2019 at 10:34 AM zlai0 [email protected] wrote:

Hi, do you have the code for pose tracking? I wonder how exactly do you encode the 15 keypoints as 15 maps?

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/aimerykong/predictive-filter-flow/issues/2, or mute the thread https://github.com/notifications/unsubscribe-auth/ABRJSJEK5AYUGA6OO6XUV3TPSCKZLANCNFSM4HIGMC7A .

aimerykong avatar Apr 24 '19 17:04 aimerykong

Hi Shu,

Sure, thanks for your quick reply. I will try that. But I was just wondering how do you dilate the joint, and how is the voting done?

zlai0 avatar Apr 24 '19 18:04 zlai0

I just simply used scipy.ndimage.binary_dilation to dilate each joint before propagating; then as for voting, I compute the coordinate mean (based on mass center) of the the propagated dots.

Regards, Shu

On Wed, Apr 24, 2019 at 11:47 AM zlai0 [email protected] wrote:

Hi Shu,

Sure, thanks for your quick reply. I will try that. But I was just wondering how do you dilate the joint, and how is the voting done?

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/aimerykong/predictive-filter-flow/issues/2#issuecomment-486378543, or mute the thread https://github.com/notifications/unsubscribe-auth/ABRJSJBBHXWHRTTNTCAYNUDPSCTKRANCNFSM4HIGMC7A .

aimerykong avatar Apr 24 '19 21:04 aimerykong

Hi Shu,

Cool. Thanks for your explanation!

zlai0 avatar Apr 25 '19 07:04 zlai0