VideoIO.jl icon indicating copy to clipboard operation
VideoIO.jl copied to clipboard

Audio support

Open ssfrr opened this issue 11 years ago • 5 comments

This seems like a good time to suggest that there should be some commonality and interoperability between AudioIO and VideoIO.

For instance, using VideoIO to strip out the audio should return the same sort of audio object as AudioIO gives you when you open a file. Currently that's an AudioFile but there should be something more abstract.

Another example would be if you set up a signal processing chain using AudioIO you could apply that to the sound track of a video, either during realtime playback or as an offline rendering operation.

There are lots of pieces in the AudioIO API that are either not yet designed or still changable, so this is a good time to make sure we're aligned.

There isn't any particular rush on this from my end, but if folks want to chat about how those interfaces should look I'm here.

ssfrr avatar Aug 11 '14 20:08 ssfrr

Thanks, Spencer--I hadn't realized that you were the maintainer of AudioIO! It would definitely be good to coordinate. I also might not get to that soon, but will ping you when I do.

(Others should definitely feel free to chime in!)

kmsquire avatar Aug 11 '14 20:08 kmsquire

Hi, is VideoIO capable of decoding MP3 audio files into an array of samples with resampling? I can do io = VideoIO.open("../data/train/000kouqjfnk.mp3") but it is not obvious if I can do anything meaningful with the result afterwards. I am new to julia and avcodec api. Thanks!

WojciechMigda avatar Sep 15 '15 16:09 WojciechMigda

I'm working on a new set of abstractions that I'm hoping will make audio easier to incorporate into other packages in a uniform way without pulling in all the AudioIO stuff. See ssfrr/AudioIO.jl#48 for some initial discussion. Hopefully by the end of this week I should be announcing an initial package more publicly.

ssfrr avatar Sep 15 '15 16:09 ssfrr

Awesome!

On Tue, Sep 15, 2015 at 9:27 AM, Spencer Russell [email protected] wrote:

I'm working on a new set of abstractions that I'm hoping will make audio easier to incorporate into other packages in a uniform way without pulling in all the AudioIO stuff. See ssfrr/AudioIO.jl#48 https://github.com/ssfrr/AudioIO.jl/issues/48 for some initial discussion. Hopefully by the end of this week I should be announcing an initial package more publicly.

— Reply to this email directly or view it on GitHub https://github.com/kmsquire/VideoIO.jl/issues/7#issuecomment-140451670.

kmsquire avatar Sep 16 '15 01:09 kmsquire

Is there any news on this? It's been years, AudioIO.jl seems dead... are there plans to include getting also the audio from videos? Are there any ways to achieve this right now in Julia?

adomasbaliuka avatar Nov 26 '21 21:11 adomasbaliuka