[PeerTube] No audio in videos with separated audio file

[q0ntinuum]

Checklist

• [X] I am able to reproduce the bug with the latest version given here: CLICK THIS LINK.
• [X] I made sure that there are no existing issues - open or closed - which I could contribute my information to.
• [X] I have read the FAQ and my problem isn't listed.
• [X] I have taken the time to fill in all the required details. I understand that the bug report will be dismissed otherwise.
• [X] This issue contains only one bug.
• [X] I have read and understood the contribution guidelines.

Affected version

0.27.2

Steps to reproduce the bug

1. Play a video transcoded with separated audio file

Expected behavior

There should be audio like when watching the video from a web browser

Actual behavior

No audio

Screenshots/Screen recordings

No response

Logs

No response

Affected Android/Custom ROM version

GrapheneOS 2024092900

Affected device model

Pixel 7 Pro

Additional information

The separated audio file option is pretty new since it was released with version 6.3 in mid september. As it could be hard to find which videos are transcoded with or without the option, here is a video: https://peertube.qontinuum.space/w/k2wKrFgGpoSSrGTCkkjoLC

[SttApollo]

Can you please assign this to me?

[SttApollo]

@opusforlife2 - I am having trouble reproducing this bug. Any suggestions? I am not sure how to locate specific videos who might be having this issues

[q0ntinuum]

@SttApollo can't you reproduce the problem using the link I provided? You could basically try any local video on this instance since they are all transcoded this way

[MFolschette]

I think I encountered the same problem on this video: https://peertube.designersethiques.org/w/9bc2ad1f-6ec7-45d7-bc01-5c5175ffe107 in case it can help you, @SttApollo

[q0ntinuum]

@MFolschette yes the same happens:

• Audio is good on the web client
• No audio when watching the video in peertube
• Audio is okay if you play it in background

[Sinestr0]

@SttApollo I am facing same issue. On https://tinkerbetter.tube you can notice that veronica explains videos works fine but Gardiner Bryant videos have no audio. The moment you start playing it background, you can have clear audio without any issues. Feel free to ask any further information to resolve this bug. Thanks in advanced.

[ShareASmile]

Please avoid pinging the guest developers, they have their own life too. If they haven't responded on earlier pings (or choosen not to) depending upon their current circumstances, that should be taken into account also while doing that. https://github.com/orgs/community/discussions/17279

[kirisakow]

@opusforlife2 - I am having trouble reproducing this bug. Any suggestions? I am not sure how to locate specific videos who might be having this issues

@AudricV Here's another one: https://video.blast-info.fr/w/87GhAwHborpk5Kym1eqZ6m

[Stypox]

Closing as this was implemented in the extractor https://github.com/TeamNewPipe/NewPipeExtractor/pull/1319, will be shipped in the next release. Unfortunately both the player and the downloader don't work well with this kind of files:

• the player can't seek well due to https://github.com/google/ExoPlayer/issues/9373, and we can't upgrade to media3 until we switch to NewPlayer
• the downloader is unable to combine/mux two segmented MP4 files and will thus only allow downloading video and audio separately. Some hard work is needed to fix this, though none of the current NewPipe devs have any experience with parsing MP4 files (@kapodamy wrote that code 6-7 years ago and it was not touched ever since). So we need someone with experience to help implementing this. I opened https://github.com/TeamNewPipe/NewPipe/issues/12443 in the meantime.