openvino_notebooks
openvino_notebooks copied to clipboard
openvinotoolkit
406 Human Pose Estimation 3D
3D Human Pose Estimation with OpenVINO
This demo contains 3D multi-person pose estimation demo. Intel OpenVINO™ backend can be used for fast inference on CPU. It is based on Lightweight OpenPose and Single-Shot Multi-Person 3D Pose Estimation From Monocular RGB papers.
The implementation of this demo starts with the ideas I originally wrote about in my blog
There are two options involved in this pull request. One is to use WebGL, which interacts with the browser, and the other is to use the less dependent OpenCV, which implements a basic 3D visual library.
406-human-pose-estimation-3d
This demo allows you to use the mouse to change the angle of view from which you view an object.
406-opencv-human-pose-estimation-3d
This example allows you to use the keyboard to move your camera and press ESC to exit.(You need to set use_popup=True firstly)
Hi @spencergotowork. Is it ready for review or do you still need to work on this?
Hi @spencergotowork. Is it ready for review or do you still need to work on this?
Yes, Adrian,thank you for your reply. I will still need to work on this. This might not the final project. Are you going to close this PR？If necessary, I will resubmit a new PR after finishing the final project.
So I converted it to draft to mark it as not ready. No need to close it.
So I converted it to draft to mark it as not ready. No need to close it.
Okay, I got it. Thank you
I don't see the results on the left side? Have you tested this on Mac or Linux?
Please make sure it exits gracefully. Catch the exception before it ends.
The OpenCV one works but the default 'view' of the 3D pose is really bad. Please find a new angle that will show the perspective as clearly as possible.
Also, it seems that the webcam image got 'resized' wrongly. The aspect ratio should never be changed, and please address that in the code.
As you can see the aspect ratio is wrong, and the left side the visualization part is really hard to see. Please address.
FYI for the error behind the scene. I think that's why it was not drawing correctly.
2022-10-04 17:07:52.512 Python[985:3590991] CMIOMS: Device unhandled hasPropertyWithAddress for kCMIOObjectPropertyOwnedObjects
2022-10-04 17:07:52.512 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIOObjectPropertyOwnedObjects self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.512 Python[985:3590991] CMIOMS: Device unhandled hasPropertyWithAddress for kCMIOObjectPropertyOwnedObjects
2022-10-04 17:07:52.512 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIOObjectPropertyOwnedObjects self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.512 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIODevicePropertyStreams self=0x112da36f8 hasProperty=1
2022-10-04 17:07:52.512 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectGetPropertyDataSize Device(36) kCMIODevicePropertyStreams self=0x112da36f8 size=4
2022-10-04 17:07:52.513 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIODevicePropertyStreams self=0x112da36f8 hasProperty=1
2022-10-04 17:07:52.513 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectGetPropertyData Device(36) kCMIODevicePropertyStreams self=0x112da36f8 data(int)=37
2022-10-04 17:07:52.513 Python[985:3590991] CMIOMS: Stream unhandled hasPropertyWithAddress for kCMIOObjectPropertyOwnedObjects
2022-10-04 17:07:52.513 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Stream(37) kCMIOObjectPropertyOwnedObjects self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.513 Python[985:3590991] CMIOMS: Stream unhandled hasPropertyWithAddress for kCMIOObjectPropertyOwnedObjects
2022-10-04 17:07:52.513 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Stream(37) kCMIOObjectPropertyOwnedObjects self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.513 Python[985:3590991] CMIOMS: Stream unhandled hasPropertyWithAddress for kCMIOObjectPropertyOwnedObjects
2022-10-04 17:07:52.513 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Stream(37) kCMIOObjectPropertyOwnedObjects self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.513 Python[985:3590991] CMIOMS: Device unhandled hasPropertyWithAddress for kCMIOObjectPropertyOwnedObjects
2022-10-04 17:07:52.513 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIOObjectPropertyOwnedObjects self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.514 Python[985:3590991] CMIOMS: Device unhandled hasPropertyWithAddress for kCMIOObjectPropertyOwnedObjects
2022-10-04 17:07:52.514 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIOObjectPropertyOwnedObjects self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.514 Python[985:3590991] CMIOMS: Device unhandled hasPropertyWithAddress for kCMIOObjectPropertyOwnedObjects
2022-10-04 17:07:52.514 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIOObjectPropertyOwnedObjects self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.514 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIODevicePropertyStreams self=0x112da36f8 hasProperty=1
2022-10-04 17:07:52.514 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectGetPropertyDataSize Device(36) kCMIODevicePropertyStreams self=0x112da36f8 size=4
2022-10-04 17:07:52.514 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIODevicePropertyStreams self=0x112da36f8 hasProperty=1
2022-10-04 17:07:52.514 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectGetPropertyData Device(36) kCMIODevicePropertyStreams self=0x112da36f8 data(int)=37
2022-10-04 17:07:52.514 Python[985:3590991] CMIOMS: Stream unhandled hasPropertyWithAddress for kCMIOObjectPropertyOwnedObjects
2022-10-04 17:07:52.514 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Stream(37) kCMIOObjectPropertyOwnedObjects self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.515 Python[985:3590991] CMIOMS: Stream unhandled hasPropertyWithAddress for kCMIOObjectPropertyOwnedObjects
2022-10-04 17:07:52.515 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Stream(37) kCMIOObjectPropertyOwnedObjects self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.515 Python[985:3590991] CMIOMS: Stream unhandled hasPropertyWithAddress for kCMIOObjectPropertyOwnedObjects
2022-10-04 17:07:52.515 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Stream(37) kCMIOObjectPropertyOwnedObjects self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.515 Python[985:3590991] CMIOMS: Device unhandled hasPropertyWithAddress for kCMIOObjectPropertyOwnedObjects
2022-10-04 17:07:52.515 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIOObjectPropertyOwnedObjects self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.515 Python[985:3590991] CMIOMS: Device unhandled hasPropertyWithAddress for kCMIOObjectPropertyOwnedObjects
2022-10-04 17:07:52.515 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIOObjectPropertyOwnedObjects self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.515 Python[985:3590991] CMIOMS: Device unhandled hasPropertyWithAddress for kCMIOObjectPropertyOwnedObjects
2022-10-04 17:07:52.515 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIOObjectPropertyOwnedObjects self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.515 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIODevicePropertyStreams self=0x112da36f8 hasProperty=1
2022-10-04 17:07:52.516 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectGetPropertyDataSize Device(36) kCMIODevicePropertyStreams self=0x112da36f8 size=4
2022-10-04 17:07:52.516 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIODevicePropertyStreams self=0x112da36f8 hasProperty=1
2022-10-04 17:07:52.516 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectGetPropertyData Device(36) kCMIODevicePropertyStreams self=0x112da36f8 data(int)=37
2022-10-04 17:07:52.516 Python[985:3590991] CMIOMS: Stream unhandled hasPropertyWithAddress for kCMIOObjectPropertyOwnedObjects
2022-10-04 17:07:52.516 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Stream(37) kCMIOObjectPropertyOwnedObjects self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.516 Python[985:3590991] CMIOMS: Stream unhandled hasPropertyWithAddress for kCMIOObjectPropertyOwnedObjects
2022-10-04 17:07:52.516 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Stream(37) kCMIOObjectPropertyOwnedObjects self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.516 Python[985:3590991] CMIOMS: Stream unhandled hasPropertyWithAddress for kCMIOObjectPropertyOwnedObjects
2022-10-04 17:07:52.516 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Stream(37) kCMIOObjectPropertyOwnedObjects self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.516 Python[985:3590991] CMIOMS: Device unhandled hasPropertyWithAddress for kCMIOObjectPropertyOwnedObjects
2022-10-04 17:07:52.516 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIOObjectPropertyOwnedObjects self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.517 Python[985:3590991] CMIOMS: Device unhandled hasPropertyWithAddress for kCMIOObjectPropertyOwnedObjects
2022-10-04 17:07:52.517 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIOObjectPropertyOwnedObjects self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.517 Python[985:3590991] CMIOMS: Device unhandled hasPropertyWithAddress for kCMIOObjectPropertyOwnedObjects
2022-10-04 17:07:52.517 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIOObjectPropertyOwnedObjects self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.517 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIODevicePropertyStreams self=0x112da36f8 hasProperty=1
2022-10-04 17:07:52.517 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectGetPropertyDataSize Device(36) kCMIODevicePropertyStreams self=0x112da36f8 size=4
2022-10-04 17:07:52.517 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIODevicePropertyStreams self=0x112da36f8 hasProperty=1
2022-10-04 17:07:52.517 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectGetPropertyData Device(36) kCMIODevicePropertyStreams self=0x112da36f8 data(int)=37
2022-10-04 17:07:52.517 Python[985:3590991] CMIOMS: Stream unhandled hasPropertyWithAddress for kCMIOObjectPropertyOwnedObjects
2022-10-04 17:07:52.517 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Stream(37) kCMIOObjectPropertyOwnedObjects self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.517 Python[985:3590991] CMIOMS: Stream unhandled hasPropertyWithAddress for kCMIOObjectPropertyOwnedObjects
2022-10-04 17:07:52.518 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Stream(37) kCMIOObjectPropertyOwnedObjects self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.518 Python[985:3590991] CMIOMS: Stream unhandled hasPropertyWithAddress for kCMIOObjectPropertyOwnedObjects
2022-10-04 17:07:52.518 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Stream(37) kCMIOObjectPropertyOwnedObjects self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.518 Python[985:3590991] CMIOMS: Device unhandled hasPropertyWithAddress for kCMIOObjectPropertyOwnedObjects
2022-10-04 17:07:52.518 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIOObjectPropertyOwnedObjects self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.518 Python[985:3590991] CMIOMS: Device unhandled hasPropertyWithAddress for kCMIOObjectPropertyOwnedObjects
2022-10-04 17:07:52.518 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIOObjectPropertyOwnedObjects self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.518 Python[985:3590991] CMIOMS: Device unhandled hasPropertyWithAddress for kCMIOObjectPropertyOwnedObjects
2022-10-04 17:07:52.518 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIOObjectPropertyOwnedObjects self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.518 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIODevicePropertyStreams self=0x112da36f8 hasProperty=1
2022-10-04 17:07:52.519 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectGetPropertyDataSize Device(36) kCMIODevicePropertyStreams self=0x112da36f8 size=4
2022-10-04 17:07:52.519 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIODevicePropertyStreams self=0x112da36f8 hasProperty=1
2022-10-04 17:07:52.519 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectGetPropertyData Device(36) kCMIODevicePropertyStreams self=0x112da36f8 data(int)=37
2022-10-04 17:07:52.519 Python[985:3590991] CMIOMS: Stream unhandled hasPropertyWithAddress for kCMIOObjectPropertyOwnedObjects
2022-10-04 17:07:52.519 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Stream(37) kCMIOObjectPropertyOwnedObjects self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.519 Python[985:3590991] CMIOMS: Stream unhandled hasPropertyWithAddress for kCMIOObjectPropertyOwnedObjects
2022-10-04 17:07:52.519 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Stream(37) kCMIOObjectPropertyOwnedObjects self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.519 Python[985:3590991] CMIOMS: Stream unhandled hasPropertyWithAddress for kCMIOObjectPropertyOwnedObjects
2022-10-04 17:07:52.520 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Stream(37) kCMIOObjectPropertyOwnedObjects self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.520 Python[985:3590991] CMIOMS: Device unhandled hasPropertyWithAddress for kCMIOObjectPropertyOwnedObjects
2022-10-04 17:07:52.520 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIOObjectPropertyOwnedObjects self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.520 Python[985:3590991] CMIOMS: Device unhandled hasPropertyWithAddress for kCMIOObjectPropertyOwnedObjects
2022-10-04 17:07:52.520 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIOObjectPropertyOwnedObjects self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.520 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIODevicePropertyTransportType self=0x112da36f8 hasProperty=1
2022-10-04 17:07:52.520 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectGetPropertyData Device(36) kCMIODevicePropertyTransportType self=0x112da36f8 data(int)=1651274862
2022-10-04 17:07:52.520 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIODevicePropertyStreams self=0x112da36f8 hasProperty=1
2022-10-04 17:07:52.521 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectGetPropertyDataSize Device(36) kCMIODevicePropertyStreams self=0x112da36f8 size=4
2022-10-04 17:07:52.521 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIODevicePropertyStreams self=0x112da36f8 hasProperty=1
2022-10-04 17:07:52.521 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectGetPropertyData Device(36) kCMIODevicePropertyStreams self=0x112da36f8 data(int)=37
2022-10-04 17:07:52.521 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectSetPropertyData Stream(37) kCMIOObjectPropertyListenerAdded self=0x112da36f8 data(int)=1885762592
2022-10-04 17:07:52.521 Python[985:3590991] CMIOMS: Stream unhandled setPropertyDataWithAddress for kCMIOObjectPropertyListenerAdded
2022-10-04 17:07:52.521 Python[985:3590991] CMIOMS: Stream unhandled hasPropertyWithAddress for Unknown selector: nefc
2022-10-04 17:07:52.521 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Stream(37) Unknown selector: nefc self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.522 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIODevicePropertyStreams self=0x112da36f8 hasProperty=1
2022-10-04 17:07:52.522 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectGetPropertyDataSize Device(36) kCMIODevicePropertyStreams self=0x112da36f8 size=4
2022-10-04 17:07:52.522 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIODevicePropertyStreams self=0x112da36f8 hasProperty=1
2022-10-04 17:07:52.522 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectGetPropertyData Device(36) kCMIODevicePropertyStreams self=0x112da36f8 data(int)=37
2022-10-04 17:07:52.522 Python[985:3590991] CMIOMS: Device unhandled hasPropertyWithAddress for kCMIOObjectPropertyOwnedObjects
2022-10-04 17:07:52.522 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIOObjectPropertyOwnedObjects self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.522 Python[985:3590991] CMIOMS: Device unhandled hasPropertyWithAddress for kCMIOObjectPropertyOwnedObjects
2022-10-04 17:07:52.522 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIOObjectPropertyOwnedObjects self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.523 Python[985:3590991] CMIOMS: Device unhandled hasPropertyWithAddress for kCMIOObjectPropertyOwnedObjects
2022-10-04 17:07:52.523 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIOObjectPropertyOwnedObjects self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.523 Python[985:3590991] CMIOMS: Stream unhandled hasPropertyWithAddress for Unknown selector: nefc
2022-10-04 17:07:52.523 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Stream(37) Unknown selector: nefc self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.523 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Stream(37) kCMIOStreamPropertyFormatDescriptions self=0x112da36f8 hasProperty=1
2022-10-04 17:07:52.523 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectGetPropertyData Stream(37) kCMIOStreamPropertyFormatDescriptions self=0x112da36f8 data(id)=(
"<CMVideoFormatDescription 0x600002bfd350 [0x7ff8478a0d70]> {\n\tmediaType:'vide' \n\tmediaSubType:'2vuy' \n\tmediaSpecific: {\n\t\tcodecType: '2vuy'\t\tdimensions: 1280 x 720 \n\t} \n\textensions: {(null)}\n}"
)
2022-10-04 17:07:52.524 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Stream(37) kCMIOStreamPropertyFrameRateRanges self=0x112da36f8 hasProperty=1
2022-10-04 17:07:52.524 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Stream(37) kCMIOStreamPropertyFrameRateRanges self=0x112da36f8 hasProperty=1
2022-10-04 17:07:52.524 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectGetPropertyDataSize Stream(37) kCMIOStreamPropertyFrameRateRanges self=0x112da36f8 size=16
2022-10-04 17:07:52.525 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Stream(37) kCMIOStreamPropertyFrameRateRanges self=0x112da36f8 hasProperty=1
2022-10-04 17:07:52.525 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectGetPropertyData Stream(37) kCMIOStreamPropertyFrameRateRanges self=0x112da36f8 data(int)=0
2022-10-04 17:07:52.525 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIODevicePropertyStreams self=0x112da36f8 hasProperty=1
2022-10-04 17:07:52.525 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectGetPropertyDataSize Device(36) kCMIODevicePropertyStreams self=0x112da36f8 size=4
2022-10-04 17:07:52.525 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIODevicePropertyStreams self=0x112da36f8 hasProperty=1
2022-10-04 17:07:52.525 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectGetPropertyData Device(36) kCMIODevicePropertyStreams self=0x112da36f8 data(int)=37
2022-10-04 17:07:52.525 Python[985:3590991] CMIOMS: Device unhandled hasPropertyWithAddress for kCMIOObjectPropertyOwnedObjects
2022-10-04 17:07:52.525 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIOObjectPropertyOwnedObjects self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.525 Python[985:3590991] CMIOMS: Device unhandled hasPropertyWithAddress for kCMIOObjectPropertyOwnedObjects
2022-10-04 17:07:52.525 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIOObjectPropertyOwnedObjects self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.526 Python[985:3590991] CMIOMS: Device unhandled hasPropertyWithAddress for kCMIOObjectPropertyOwnedObjects
2022-10-04 17:07:52.526 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIOObjectPropertyOwnedObjects self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.526 Python[985:3590991] CMIOMS: Stream unhandled hasPropertyWithAddress for Unknown selector: nefc
2022-10-04 17:07:52.526 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Stream(37) Unknown selector: nefc self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.526 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Stream(37) kCMIOStreamPropertyFormatDescription self=0x112da36f8 hasProperty=1
2022-10-04 17:07:52.526 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectGetPropertyData Stream(37) kCMIOStreamPropertyFormatDescription self=0x112da36f8 data(id)=<CMVideoFormatDescription 0x600002bfd560 [0x7ff8478a0d70]> {
mediaType:'vide'
mediaSubType:'2vuy'
mediaSpecific: {
codecType: '2vuy' dimensions: 1280 x 720
}
extensions: {(null)}
}
2022-10-04 17:07:52.526 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Stream(37) kCMIOStreamPropertyFrameRateRanges self=0x112da36f8 hasProperty=1
2022-10-04 17:07:52.526 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Stream(37) kCMIOStreamPropertyFrameRateRanges self=0x112da36f8 hasProperty=1
2022-10-04 17:07:52.526 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectGetPropertyDataSize Stream(37) kCMIOStreamPropertyFrameRateRanges self=0x112da36f8 size=16
2022-10-04 17:07:52.526 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Stream(37) kCMIOStreamPropertyFrameRateRanges self=0x112da36f8 hasProperty=1
2022-10-04 17:07:52.527 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectGetPropertyData Stream(37) kCMIOStreamPropertyFrameRateRanges self=0x112da36f8 data(int)=0
2022-10-04 17:07:52.527 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Stream(37) kCMIOStreamPropertyFrameRate self=0x112da36f8 hasProperty=1
2022-10-04 17:07:52.527 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectGetPropertyData Stream(37) kCMIOStreamPropertyFrameRate self=0x112da36f8 data(int)=0
2022-10-04 17:07:52.527 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Stream(37) kCMIOStreamPropertyMinimumFrameRate self=0x112da36f8 hasProperty=1
2022-10-04 17:07:52.527 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Stream(37) kCMIOStreamPropertyMinimumFrameRate self=0x112da36f8 hasProperty=1
2022-10-04 17:07:52.527 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectGetPropertyData Stream(37) kCMIOStreamPropertyMinimumFrameRate self=0x112da36f8 data(int)=0
2022-10-04 17:07:52.527 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIODevicePropertyStreams self=0x112da36f8 hasProperty=1
2022-10-04 17:07:52.527 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectGetPropertyDataSize Device(36) kCMIODevicePropertyStreams self=0x112da36f8 size=4
2022-10-04 17:07:52.527 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIODevicePropertyStreams self=0x112da36f8 hasProperty=1
2022-10-04 17:07:52.528 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectGetPropertyData Device(36) kCMIODevicePropertyStreams self=0x112da36f8 data(int)=37
2022-10-04 17:07:52.528 Python[985:3590991] CMIOMS: Stream unhandled hasPropertyWithAddress for Unknown selector: cafc
2022-10-04 17:07:52.528 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Stream(37) Unknown selector: cafc self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.528 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIOObjectPropertyName self=0x112da36f8 hasProperty=1
2022-10-04 17:07:52.528 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectGetPropertyData Device(36) kCMIOObjectPropertyName self=0x112da36f8 data(id)=Sony Camera (Imaging Edge)
2022-10-04 17:07:52.529 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIODevicePropertyModelUID self=0x112da36f8 hasProperty=1
2022-10-04 17:07:52.529 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectGetPropertyData Device(36) kCMIODevicePropertyModelUID self=0x112da36f8 data(id)=0000
2022-10-04 17:07:52.529 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIOObjectPropertyManufacturer self=0x112da36f8 hasProperty=1
2022-10-04 17:07:52.529 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectGetPropertyData Device(36) kCMIOObjectPropertyManufacturer self=0x112da36f8 data(id)=Digital-iz.inc
2022-10-04 17:07:52.529 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIODevicePropertyLinkedCoreAudioDeviceUID self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.529 Python[985:3590991] CMIOMS: Device unhandled hasPropertyWithAddress for kCMIODevicePropertySuspendedByUser
2022-10-04 17:07:52.530 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIODevicePropertySuspendedByUser self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.530 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIODevicePropertyHogMode self=0x112da36f8 hasProperty=1
2022-10-04 17:07:52.530 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectGetPropertyData Device(36) kCMIODevicePropertyHogMode self=0x112da36f8 data(int)=-1
2022-10-04 17:07:52.530 Python[985:3590991] CMIOMS: Device unhandled hasPropertyWithAddress for kCMIOObjectPropertyOwnedObjects
2022-10-04 17:07:52.530 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIOObjectPropertyOwnedObjects self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.530 Python[985:3590991] CMIOMS: Device unhandled hasPropertyWithAddress for kCMIOObjectPropertyOwnedObjects
2022-10-04 17:07:52.530 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIOObjectPropertyOwnedObjects self=0x112da36f8 hasProperty=0
2022-10-04 17:07:52.532 Python[985:3590991] =>> Checked Property: [cfen] 1667655022
2022-10-04 17:07:52.532 Python[985:3590991] =>> Checked Property: [cfen] 1667655022
2022-10-04 17:07:52.532 Python[985:3590991] =>> Checked Property: [cfen] 1667655022
2022-10-04 17:07:52.532 Python[985:3590991] =>> Checked Property: [cfac] 1667653987
[I 2022-10-04 17:09:23.407 ServerApp] Kernel interrupted: 02da9dfa-ca9a-4485-9311-384e0cdfcd10
2022-10-04 17:09:23.436 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectHasProperty Device(36) kCMIODevicePropertyDeviceIsRunningSomewhere self=0x112da36f8 hasProperty=1
2022-10-04 17:09:23.436 Python[985:3590991] CMIOMS: HardwarePlugIn_ObjectGetPropertyData Device(36) kCMIODevicePropertyDeviceIsRunningSomewhere self=0x112da36f8 data(int)=1
Also, please make sure you select "Python 3" but not your custom openvino_env1 or 2 etc... When we release it out the default has to be Python 3 or it will confuse the users. @raymondlo84 fixed a few typos and the intro
Run nbqa flake8 --ignore=E124,E203,E231,E266,E402,E501,E703,F821,W503,W291,W293 --nbqa-exclude="(301.)|(302.)" notebooks notebooks/406-human-pose-estimation-3d/406-human-pose-estimation-3d.ipynb:cell_1:4:1: F401 'warnings' imported but unused notebooks/406-human-pose-estimation-3d/406-human-pose-estimation-3d.ipynb:cell_3:17:14: F541 f-string is missing placeholders notebooks/406-human-pose-estimation-3d/406-opencv-human-pose-estimation-3d.ipynb:cell_2:17:14: F541 f-string is missing placeholders
Also, please address these so we can pass the CI.
pythreejs
we are missing this in the requirements.txt
Thank you very much for your review. For this I refer to this demo, which adds additional toolkits in subdirectories. But now it was in the requirements.txt of the project's root directory. Thanks to your changes.
I've tested it on Windows, Ubuntu, binder before and haven't seen anything like this, but the output you mentioned later seems to be device related?
Please make sure it exits gracefully. Catch the exception before it ends.
Fixed on the latest commit. :)
Regarding the display problem of Method 2, I changed the size of the human and the position of the virtual camera, and now the display effect is as shown in the above picture. The image is now scaled according to the length and width ratio of the original video, and the code can be seen in the last commit.
I've tested it on Windows, Ubuntu, binder before and haven't seen anything like this, but the output you mentioned later seems to be device related?
Do you have a Mac? Can you ask a friend to try on Mac OS 12.6
Also, you may want to update the branch and retest everything with a new setup. Like starting from git clone step and new virtual environment.
Regarding the display problem of Method 2, I changed the size of the human and the position of the virtual camera, and now the display effect is as shown in the above picture. The image is now scaled according to the length and width ratio of the original video, and the code can be seen in the last commit.
Try to make the 3D rendering part more 'full screen'? Like fill up the empty space more by zoom in a little bit more.
Please validate the model again. The coordinate seems to be flipped (try raising your hands and rotate around). Also, it would be great the draw the line a bit thicker as it's very hard to see.
Also, the aspect ratio is still incorrect from my webcam feed. Please check one more time to ensure it's handling the resizing correctly.
https://www.awesomescreenshot.com/video/11685332?key=d9acd51b0aa8e7ad41359ec9cdc1c12f the arms and moving randomly-- please recheck all coordinate systems and mapping.
I've tested it on Windows, Ubuntu, binder before and haven't seen anything like this, but the output you mentioned later seems to be device related?
Do you have a Mac? Can you ask a friend to try on Mac OS 12.6
I got same issue as you on MacOS
https://www.awesomescreenshot.com/video/11685332?key=d9acd51b0aa8e7ad41359ec9cdc1c12f the arms and moving randomly-- please recheck all coordinate systems and mapping.
Hi, I've seen this happen in my previous tests, and I think it's probably a problem with the model, which works the same effect in model zoo. And I think you need to keep the distance from the camera so that the model can capture your legs or waist, so that raising the hands again will not be inaccurate. I used the same way in our previous meetings.
I've tested it on Windows, Ubuntu, binder before and haven't seen anything like this, but the output you mentioned later seems to be device related?
Do you have a Mac? Can you ask a friend to try on Mac OS 12.6
I got same issue as you on MacOS
So you are using chrome, right? I learned that the pythreejs toolkit does not look well on some versions of browsers.
Could help to sync with another notebook on updates you created as well ? For example: model.reshape function
Thank you for reminding me. I think I may have pushed the wrong version of the file before
hi @spencergotowork thanks for your contribution. the demo's results looks great to me.
It works on mac now?
hi @spencergotowork thanks for your contribution. the demo's results looks great to me.
It works on mac now?
Hi, @OpenVINO-dev-contest , have you been able to run this demo successfully on macos before? I'm at home, so I don't have a macos device nearby to debug. I saw in the official pythreejs repository that this tool is having problems running on some versions of the browser.So I thought maybe the solution would be to try another browser.
hi @spencergotowork thanks for your contribution. the demo's results looks great to me.
It works on mac now?
Hi, @OpenVINO-dev-contest , have you been able to run this demo successfully on macos before? I'm at home, so I don't have a macos device nearby to debug. I saw in the official pythreejs repository that this tool is having problems running on some versions of the browser.So I thought maybe the solution would be to try another browser.
Yes, it works for me on safari now, thanks
hi @spencergotowork thanks for your contribution. the demo's results looks great to me.
It works on mac now?
Hi, @OpenVINO-dev-contest , have you been able to run this demo successfully on macos before? I'm at home, so I don't have a macos device nearby to debug. I saw in the official pythreejs repository that this tool is having problems running on some versions of the browser.So I thought maybe the solution would be to try another browser.
Yes, it works for me on safari now, thanks
chrome? and firefox?