[Question] Synchronize playback progress between multiple AVProVideo instances.

[fantastxu]

AVPro Video Version

3.2.6

Which platform is your question for?

Windows

Your question

Hi

We are currently using Unity's AVPro plugin for VR video playback. We need to decode 16K videos, but NVIDIA doesn't support hardware decoding for 16K resolution. Therefore, we are attempting to split 16K videos into multiple 8K videos and play them synchronously using multiple AVPro instances.

When using multiple AVPro instances for this approach, synchronization is a critical issue. For example, we need all instances to load their respective 8K video segments first before starting playback synchronously. During playback, we need to continuously monitor the playback progress of each instance, and if we detect mismatched progress, we need a synchronization process to keep all video segments aligned.

Key technical questions for AVPro developers:

1. Can multiple AVPro instances be synchronized to start playback simultaneously after all video segments are loaded?
2. What APIs are available for real-time progress monitoring and comparison between multiple instances?
3. Does AVPro provide built-in synchronization mechanisms when playback drift occurs between instances?
4. What is the typical synchronization accuracy (frame-level or time-based) that can be achieved?
5. Are there any recommended best practices for maintaining sync between multiple AVPro instances playing segmented high-resolution video content?
6. What are the performance implications of running multiple AVPro instances simultaneously for 8K video decoding?
7. Does AVPro have any specific optimizations or recommendations for handling split high-resolution video scenarios like ours?

This synchronization capability is crucial for our 16K VR video playback solution, as any drift between video segments would create visual artifacts in the final combined output.

Thank you guys!

[Chris-RH]

Have you tried using the HAP codec for your high resolution video?

[fantastxu]

Hi Chris-RH Thank you for the response. For the configuration, and I have already checked the Hap/NotchLC as below

I only got about 10 fps when using this configuration by using 4090D nvidea card with 12GB video memory.

Sorry that I can't upload the video but there is the detailed info: