react-native-mediapipe icon indicating copy to clipboard operation
react-native-mediapipe copied to clipboard

enable tuning or auto-tuning of framerate for processing on slower devices

Open cdiddy77 opened this issue 1 year ago • 0 comments

On android, even though we are running the mediapipe processor asynchronously, we are currently forced to convert the image from yuv to rgb as part of every frame, which makes it impossible to maintain 30fps especially on slower devices

https://react-native-vision-camera.com/docs/guides/frame-processors#running-at-a-throttled-fps-rate documents a mechanism that visioncamera provides for doing frame processing more seldom than the full frame rate of the camera.

Experiment with using the inference time to auto-tune the target fps. If that doesn't work, then at least provide a reasonable default setting on android and allow the client to override the target fps.

cdiddy77 avatar Apr 03 '24 13:04 cdiddy77