Audio from external file like MLRV

[ilia3101]

A comment left on a video of mine mentioned this idea: https://vimeo.com/240298592

Maybe you could join the conversation too...

.... But basically they want an ability to load an external audio from a file and adjust the time to sync it.

Also currently away till the 30th with no ability to write code!!!! 😢😭💀:(

[masc4ii]

Hm, this does not sound so difficult to realize. But if we do that, we should remember another user, who wants get the audio from the h.264 proxy (he records proxy on SD and RAW on CF at the same time). But maybe first steps is loading the wav. Then we can transform a mp4 to wav (ffmpeg should be able) and load it in the same way. The most difficult is to adjust the audio - is it long enough, drag to the front, drag to the rear...

Edit: puh... when thinking about it is not so easy... audio settings/parameter (they can be very different) are going very deep in the playback engine etc. ... it is not just exchanging data and pressing the play button :-(

A question is, what exactly shall be implemented?! Do we only want to playback the audiofile or do you want to export it with the video as well?

Playback+Export: We need a kind of switch between MLV-wav and EXT-wav. All audio macros needs to be adapted to the switch. Otherwise the playback and GUI-audio-part must be implemented twice.

Playback only: let's load any audio in Qt-lib and play it back.

[bouncyball-git]

Implementing only external audio playback is easy. 2 audio track editing is hard. The ability to add 2nd audio track and mix them together this is challenging but very nice feature to have :)

[SoyLeor]

thank you very much everyone, I would like to help you but I am not as smart as you hehehee ))). I really like the MLRAWViewer APP , it has many precise and direct tools, it does its job well but with many limitations. If MLV-APP could select the dropper color temperature, this would be phenomenal, and a more fluid reproduction even if this necessitates a low quality display option to play smoothly. ;)

[bouncyball-git]

@SoyLeor

The discussion for 1st request of yours is here

Playing smoothly does not depend on displayed image resolution it depends on 'raw_correction->debayer->image_processing' pipeline which is very CPU hungry.

Edit: you can try to switch drop frame mode from the menu, in this case the playback is semi realtime and can be synced with audio.

Edit2: for more fluid playback turn off the raw correction entirely and switch to log-c or cineon log space.

[masc4ii]

@bouncyball-git : I would not implement 2 track audio, I think this is a task for tools like FCPX / Premiere/... I would implement a kind of switch: MLV audio OR external audio. And even this is not as easy as it sounds. In the past I never thought about adding external audio - I always did that in FCPX or an equivalent tool.

@SoyLeor : The audio request is here. The request "Whitebalance picker" is ready since many weeks from GUI side (is only hidden atm). You have to be very kind to Ilia and asking with a big "PLEEEEAAAASE", and maybe he can implement the algorithms in the processing library. :-) This request you'll find here: #26 . The request "Performance" is a general problem we are working on all the time. There are many ideas how to improve but that all needs its time. But in nearly every new version it is a little bit better here or there. But even on older computers you should get around 10 frames at FullHD with the right settings and the right viewer size.

[SoyLeor]

I'm sorry🙈 if I can seem rude but I need help from the Google @translator 😁😂😂...

I have been experimenting with RAW for a short time, and now I want to devote myself more to this, I made a very unpretentious first music video clip, and I explore the workflow RAW-> DNGcinema-> Resolve-> Proxy FCPX-> Resolve to finish, now I understand that the audio can be easily added and synchronized in FCPX, but honestly I would like to have the audio added in MLV-APP and export it DNGcinema with the linked audio. 🙃😊

Audios in environments in music video clip? they are necessary for a "behind the scenes" for example. 😉

I admire the work they do behind the interface that many of us enjoy. My respects and congratulations. 🙌👍

[bouncyball-git]

I would not implement 2 track audio, I think this is a task for tools like FCPX / Premiere/... I would implement a kind of switch: MLV audio OR external audio. And even this is not as easy as it sounds. In the past I never thought about adding external audio - I always did that in FCPX or an equivalent tool.

+1, it is pointless to add audio substitution feature IMHO. Especially DNG audio link or something.

[masc4ii]

I can understand the wish from a 50D user, where the audio is recorded on a external recorder. Also the 5D3 user, who records audio in the H.264 on SD and records RAW without audio will like to get the audio track in there. But implementing a workflow easier or better than in FCPX (just drag & ready) is hard to realize. There is a lot to do in background... There are many questions to the 50D users:

• what, if audio is to short for the clip? -> export & playback problem
• what, if audio starts to late or ends to early?
• what, if audio is a format we do not support (do we want to support any format? puhhh)
• what, if recorder records a little bit faster or slower than the EOS, there will never be a sync possible (may not be a real problem)
• ...

Sometimes I start to understand why Resolve also started as Grading Tool and is now what it is... there will always be another wish :-) (what must not be bad)

[SoyLeor]

hahaha ... I understand very well that it is a problem to spend time with specific users, when more work is required for the basic functions of the MLV APP to work at the desired level. Maybe because of my lack of experience I think it's better to have the backups as compact as possible and not have to back up sessions of FCPX to maintain the relationship of the audio with the video.

MLRAWViewer only supports WAV 16Bits 48KHz formats, sincerely I have not tested 44KHz, but I know that it does not support 24Bits or Mp3, I used my smartphone with an APP that records in the format supported, all started up to 5-7 seconds later and when synchronizing with the MLV and exporting to cDNG only the first seconds of the auidio was like applying a mute. Exports the audio based on the number of frames.

Being able to do this is already a great achievement, and we will have to use external recorders compatible with this option, you can not please everyone jajajaa

The 50D offers incredible quality, and before buying a 5D 2 or 3, I need to buy other minimum tools. :)

[SoyLeor]

Merry Christmas to all, I remind you that I write with the help of the google translator, if it seems that I am rude, it is not true, I am very respectful and kind and everything is the fault of google hahahaaa.

I do not want to look like the orchestra director, just give ideas because I can not program like you. I know that the modifications to MLV-APP require time, sincerely I did not know that 5DMK3 records RAW without audio, I suppose that everyone who records in RAW has minimal knowledge of tools for audio and video postproduction, and that the most important thing is that MLV- APP can initially load a standard audio file for video (WAV 16Bits 48KHz); synchronize it as accurately as possible and export with ProRes or cDNG and others based on the first and last frame. Each user will have to find a way to obtain this audio in the format accepted by MLV-APP, it will be a great achievement.

[masc4ii]

Merry Christmas to you too! No problem, we are just discussing what makes sense and what not - On what we have to think about when programming something like that and so on. ;-)

[ilia3101]

Merry Christmas everyone!

So is this going to happen? I just thought all we need is to load, then put the audio by default at the start of the clip (whether it is shorter or longer) and allow user to move it forward and back by small increments. We could use ffmpeg to decode it from a h264 video... an mp3 file or any format at all...

Surely we can match MLRawViewer in every way 😉

[masc4ii]

Merry christmas to you too! :-) Did you read what I wrote above? We need to manipulate all macros giving information about audio too. And this goes deep in the code...

[bouncyball-git]

Merry Christmas guys :)

[bouncyball-git]

This definitely can be done but I'm too lazy to get my neck to this hoop :)