Basic replacement for PyAV and future needs

[jnebrera]

Hi all,

I'm currently using PyAV in Google Colab to decode a video file (audio + video), process the video frame using object detection, and resize it, and finally, reencode the video while keeping the original audio.

Unfortunately, by using PyAV we have been hot with a big performance drop compared to Norgear OpenCV video grabber (that lacks audio part)

I'm seeking for a Python alternative that fully exploits hardware acceleration both in the decoding (NVDEC) and encoding (NVEND) parts, but also allows me to work with the audio part (no processing itself needed, but cannot lose it)

Is ffmpeg-python the right library to achieve this?

If yes, in the future I hope to grab the video from a RTSP camera and push the stream to a RTMP server like Youtube and such. Is this doable too?

And a final question, if both are ok, one thing I have in mind is to overlay HTML content into the video stream. I'm aware ffmpeg allows for image and text overlays, but I wonder if anybody knows about such capability for ffmpeg.

Thank you very much for your help.