PoseNet demo

[genderev]

Dear ml5 community,

I'm submitting a PoseNet demo. Please help me make it better.

→ Step 1: Describe the issue 📝

I tried to make a demo for PoseNet, but I don't understand the demo's behavior.

My goal is to recreate action painting - when you move, the demo draws strokes on the screen.

The issue is that the drawing/painting on the screen only somewhat correlates with body movement.

→ Step 2: Screenshots or Relevant Documentation 🖼

Here's some helpful screenshots and/or documentation.

I don't know if you can tell from this screenshot, but I created a new canvas that is drawn on when you physically move your body. The issue is that I'm not completely sure why the strokes are so jagged and erratic.

→ Step 3: Share an example of the issue 🦄

Here's some example code or a demonstration of my feature in this issue, separate GitHub repo, or in the https://editor.p5js.org or codepen/jsfiddle/Glitch/etc...

PoseNet demo PoseNet demo source code

→ Describe your setup 🦄

Here's some helpful information about my setup...

• Web browser & version: ungoogled-chromium 90
• Operating System: MacOS (Darwin)
• ml5 version you're using: Latest version
• Any additional notes: I would like to be able to control how the canvas creates strokes from webcam movement.

[tlsaeger]

Hi @genderev thanks for raising this. I would highly recommend to start from just one PoseNet point. You could e.g. start with the nose and then include more and more points. What you are doing is also drawing the connections between the joints. Maybe try to first get thins sorted with the joints themselves you want to include, then continue with the connection. Feel also free to join our discord: https://discord.com/invite/3CVauZMSt7