Mediapipe4u-plugin

Mediapipe4u-plugin copied to clipboard

MediaPipe4U Version

20231011

UE Version

5.2.x

UnrealEngine Type

Install From Epic Games Launcher

Platform

Windows

What happened?

The game works fine in editor, but when I package the game with development configuration the webcam does not open and the motion capture does not work. I will attach here the full log generated by the build, but after looking at it I think this is the most important part. It prints the log below everytime I click to start webcam.

[2024.04.04-17.26.16:149][184]LogMediaPipe: Display: Wait for the dynamic texture to stop rendering...
[2024.04.04-17.26.16:149][184]LogMediaPipe: Display: Dynamic texture rendering has stopped
[2024.04.04-17.26.16:149][184]LogMediaPipe: Display: ~FDynamicTexture 000001997FE795E0
[2024.04.04-17.26.16:149][184]LogMediaPipe: Display: [MediaPipa API] MediaPipe builtin graph used (CPU).
[2024.04.04-17.26.16:149][184]LogMediaPipe: Display: [MediaPipa API] MediaPipe pipeline stopping...
[2024.04.04-17.26.16:149][184]LogMediaPipe: Display: [MediaPipa API] UmpPipeline::Shutdown OK
[2024.04.04-17.26.16:149][184]LogMediaPipe: Display: [MediaPipa API] MediaPipe pipeline stopped.
[2024.04.04-17.26.16:149][184]LogMediaPipe: Display: [MediaPipa API] MediaPipe graph nodes: 6

[2024.04.04-17.26.16:149][184]LogMediaPipe: Display: [MediaPipa API] Run mediapipe graph...
[2024.04.04-17.26.16:172][184]LogMediaPipe: Display: [MediaPipa API] Configure mediapipe graph succeed.
[2024.04.04-17.26.16:172][184]LogMediaPipe: Display: [MediaPipa API] Graph is ready (pollers: 0, observers: 6).
[2024.04.04-17.26.16:172][184]LogMediaPipe: Display: [MediaPipa API] enable_segmentation : bool
input_flip_horizontally : bool
input_flip_vertically : bool
input_rotation_degrees : int
model_complexity : int
refine_face_landmarks : bool
smooth_landmarks : bool
smooth_segmentation : bool
use_prev_landmarks : bool

[2024.04.04-17.26.16:173][184]LogMediaPipe: Display: [MediaPipa API] MediaPipe graph is launched.
[2024.04.04-17.26.16:174][184]LogMediaPipe: Error: Unable to find mediapipe model file: mediapipe/modules/pose_detection/pose_detection.tflite
[2024.04.04-17.26.16:174][184]LogMediaPipe: Error: Unable to find mediapipe model file: mediapipe/modules/pose_landmark/pose_landmark_full.tflite
[2024.04.04-17.26.16:174][184]LogMediaPipe: Error: Unable to find mediapipe model file: mediapipe/modules/hand_landmark/hand_landmark_full.tflite
[2024.04.04-17.26.16:174][184]LogMediaPipe: Error: Unable to find mediapipe model file: mediapipe/modules/hand_landmark/hand_landmark_full.tflite
[2024.04.04-17.26.16:174][184]LogMediaPipe: Error: Unable to find mediapipe model file: mediapipe/modules/face_landmark/face_landmark.tflite
[2024.04.04-17.26.16:174][184]LogMediaPipe: Error: Unable to find mediapipe model file: mediapipe/modules/pose_detection/pose_detection.tflite
[2024.04.04-17.26.16:174][184]LogMediaPipe: Error: [MediaPipa API] E20240404 14:26:16.174685 27076 calculator_graph.cc:853] FAILED_PRECONDITION: CalculatorGraph::Run() failed in Run: 
Calculator::Open() for node "holisticlandmarkcpu__poselandmarkcpu__poselandmarkbyroicpu__poselandmarkmodelloader__LocalFileContentsCalculator" failed: Failed to read resource: mediapipe/modules/pose_landmark/pose_landmark_full.tflite
Calculator::Open() for node "holisticlandmarkcpu__handlandmarksleftandrightcpu__handlandmarksfromposecpu_1__handlandmarkcpu__handlandmarkmodelloader__LocalFileContentsCalculator" failed: Failed to read resource: mediapipe/modules/hand_landmark/hand_landmark_full.tflite
Calculator::Open() for node "holisticlandmarkcpu__handlandmarksleftandrightcpu__handlandmarksfromposecpu_2__handlandmarkcpu__handlandmarkmodelloader__LocalFileContentsCalculator" failed: Failed to read resource: mediapipe/modules/hand_landmark/hand_landmark_full.tflite
Calculator::Open() for node "holisticlandmarkcpu__facelandmarksfromposecpu__facelandmarkcpu__facelandmarksmodelloader__LocalFileContentsCalculator" failed: Failed to read resource: mediapipe/modules/face_landmark/face_landmark.tflite
Calculator::Open() for node "holisticlandmarkcpu__poselandmarkcpu__posedetectioncpu__inferencecalculator__holisticlandmarkcpu__poselandmarkcpu__posedetectioncpu__InferenceCalculator" failed: Failed to read resource: mediapipe/modules/pose_detection/pose_detection.tflite

[2024.04.04-17.26.16:174][184]LogMediaPipe: Warning: [MediaPipa API] E20240404 14:26:16.174685 27076 calculator_graph.cc:853] FAILED_PRECONDITION: CalculatorGraph::Run() failed in Run: 
Calculator::Open() for node "holisticlandmarkcpu__poselandmarkcpu__poselandmarkbyroicpu__poselandmarkmodelloader__LocalFileContentsCalculator" failed: Failed to read resource: mediapipe/modules/pose_landmark/pose_landmark_full.tflite
Calculator::Open() for node "holisticlandmarkcpu__handlandmarksleftandrightcpu__handlandmarksfromposecpu_1__handlandmarkcpu__handlandmarkmodelloader__LocalFileContentsCalculator" failed: Failed to read resource: mediapipe/modules/hand_landmark/hand_landmark_full.tflite
Calculator::Open() for node "holisticlandmarkcpu__handlandmarksleftandrightcpu__handlandmarksfromposecpu_2__handlandmarkcpu__handlandmarkmodelloader__LocalFileContentsCalculator" failed: Failed to read resource: mediapipe/modules/hand_landmark/hand_landmark_full.tflite
Calculator::Open() for node "holisticlandmarkcpu__facelandmarksfromposecpu__facelandmarkcpu__facelandmarksmodelloader__LocalFileContentsCalculator" failed: Failed to read resource: mediapipe/modules/face_landmark/face_landmark.tflite
Calculator::Open() for node "holisticlandmarkcpu__poselandmarkcpu__posedetectioncpu__inferencecalculator__holisticlandmarkcpu__poselandmarkcpu__posedetectioncpu__InferenceCalculator" failed: Failed to read resource: mediapipe/modules/pose_detection/pose_detection.tflite

[2024.04.04-17.26.16:174][184]LogMediaPipe: Display: [MediaPipa API] E20240404 14:26:16.174685 27076 calculator_graph.cc:853] FAILED_PRECONDITION: CalculatorGraph::Run() failed in Run: 
Calculator::Open() for node "holisticlandmarkcpu__poselandmarkcpu__poselandmarkbyroicpu__poselandmarkmodelloader__LocalFileContentsCalculator" failed: Failed to read resource: mediapipe/modules/pose_landmark/pose_landmark_full.tflite
Calculator::Open() for node "holisticlandmarkcpu__handlandmarksleftandrightcpu__handlandmarksfromposecpu_1__handlandmarkcpu__handlandmarkmodelloader__LocalFileContentsCalculator" failed: Failed to read resource: mediapipe/modules/hand_landmark/hand_landmark_full.tflite
Calculator::Open() for node "holisticlandmarkcpu__handlandmarksleftandrightcpu__handlandmarksfromposecpu_2__handlandmarkcpu__handlandmarkmodelloader__LocalFileContentsCalculator" failed: Failed to read resource: mediapipe/modules/hand_landmark/hand_landmark_full.tflite
Calculator::Open() for node "holisticlandmarkcpu__facelandmarksfromposecpu__facelandmarkcpu__facelandmarksmodelloader__LocalFileContentsCalculator" failed: Failed to read resource: mediapipe/modules/face_landmark/face_landmark.tflite
Calculator::Open() for node "holisticlandmarkcpu__poselandmarkcpu__posedetectioncpu__inferencecalculator__holisticlandmarkcpu__poselandmarkcpu__posedetectioncpu__InferenceCalculator" failed: Failed to read resource: mediapipe/modules/pose_detection/pose_detection.tflite

[2024.04.04-17.26.16:174][184]LogMediaPipe: Error: [MediaPipa API] Failed to run mediapipe graph.
FAILED_PRECONDITION: CalculatorGraph::Run() failed in Run: 
Calculator::Open() for node "holisticlandmarkcpu__poselandmarkcpu__poselandmarkbyroicpu__poselandmarkmodelloader__LocalFileContentsCalculator" failed: Failed to read resource: mediapipe/modules/pose_landmark/pose_landmark_full.tflite
Calculator::Open() for node "holisticlandmarkcpu__handlandmarksleftandrightcpu__handlandmarksfromposecpu_1__handlandmarkcpu__handlandmarkmodelloader__LocalFileContentsCalculator" failed: Failed to read resource: mediapipe/modules/hand_landmark/hand_landmark_full.tflite
Calculator::Open() for node "holisticlandmarkcpu__handlandmarksleftandrightcpu__handlandmarksfromposecpu_2__handlandmarkcpu__handlandmarkmodelloader__LocalFileContentsCalculator" failed: Failed to read resource: mediapipe/modules/hand_landmark/hand_landmark_full.tflite
Calculator::Open() for node "holisticlandmarkcpu__facelandmarksfromposecpu__facelandmarkcpu__facelandmarksmodelloader__LocalFileContentsCalculator" failed: Failed to read resource: mediapipe/modules/face_landmark/face_landmark.tflite
Calculator::Open() for node "holisticlandmarkcpu__poselandmarkcpu__posedetectioncpu__inferencecalculator__holisticlandmarkcpu__poselandmarkcpu__posedetectioncpu__InferenceCalculator" failed: Failed to read resource: mediapipe/modules/pose_detection/pose_detection.tflite
[2024.04.04-17.26.16:174][184]LogMediaPipe: Display: [MediaPipa API] MediaPipe pipeline stopping...
[2024.04.04-17.26.16:174][184]LogMediaPipe: Display: [MediaPipa API] Begin CalculatorGraph::WaitUntilDone ...
[2024.04.04-17.26.16:174][184]LogMediaPipe: Display: [MediaPipa API] CalculatorGraph::WaitUntilDone: 9
[2024.04.04-17.26.16:176][184]LogMediaPipe: Display: [MediaPipa API] UmpPipeline::Shutdown OK
[2024.04.04-17.26.16:176][184]LogMediaPipe: Display: [MediaPipa API] MediaPipe pipeline stopped.
[2024.04.04-17.26.16:176][184]LogMediaPipe: Error: Unable to start mediapipe pipline.

Here is the full log

mediapipe-project.log

If you run M4U in packaged game, there is a known issue?

refer this: #130

fix at 202405XX