ruffle
ruffle copied to clipboard
ruffle-rs
Onda: Animacuentos (Cuentos - LL & LLSE) FLV Playback
Describe the bug
Now that FLV support is coming in, I now realize that this section of the platform controls its playback via a handful of MX functions, (NCManager). Essentially, this section plays a FLV in the upper left and synchronizes it with SWF content to the right and below using a series of timeouts and seek-points.
https://drive.google.com/drive/folders/163YKuJK_4Hf8bFpo5tAYp8mgzfVp74y8?usp=sharing
So thee FLV content loads, but it cannot be interacted with due to lack of support of the content within mx.video.NCManager
Expected behavior
FLV should play with the corresponding SWFs being able to synchronize at their respective seek points.
Affected platform
Self-hosted version
Operating system
Windows 11
Browser
Chromium based or Firefox
Additional information
No response
Possibly the same thing that's happening here: http://labcenter.dnalc.org/labs/dnaextraction/dnaextraction_d.html
A testing site has been spun up at https://sombrastorage.z19.web.core.windows.net/ruffle/toto.
It seems (separate from the problem this issue is meant to tackle), that there is a race condition of some kind where the FLV and the surrounding Flash content simply takes too long to load and it causes the FLV to just sort of fail to completely load. If you refresh the page, it will eventually come. It seems like a performance issue when things aren't cached.
I found that the Flash-compatible webpage is here: http://20.232.158.68/toto/flash.html This can make testing/comparison easier.
mx.video.VideoPlayer has a bunch of calls to unimplemented NetStream methods, I'm not sure if any of them actually get called though. It also sets up event handlers for onMetaData and onCuePoint, which are both ScriptData handlers that don't get called yet.
The FLV in the project does not have any onCuePoint calls, but it does have an ordinary onMetaData block. Not sure if MX requires the metadata block actually exist in order to play FLVs - bare Video objects will totally play movies without a metadata block.
This will need more investigation.
I would suspect that since this particular application relies on syncing particular frames at particular points, that mx requires timestamp data in order to know how and where to seek.
I found that the Flash-compatible webpage is here: http://20.232.158.68/toto/flash.html This can make testing/comparison easier.
As mentioned in the now edited comments, this can now be found at https://sombrastorage.z19.web.core.windows.net/ruffle/toto/flash.html
I think the video and seeking part of this is fixed now - the remaining issue is that the SWF in the top right corner is obscured, unless zoomed in...?
Oh, no, that's just pathing stupidity with Azure Storage. I've adjusted the Flash version so that it paths correctly, but you can also go to the self-host version (just don't try to switch between them while that page is still loaded) from https://sombrastorage.z19.web.core.windows.net/ruffle/toto/ The self-host version works as expected. It does of course desync when the tab/window is defocused, but as we know, that's rather par for the course on a lot of content.