DONT KNOW 'How to bring both sounds data and videos data from gstreamer'

[Hikaru-Furuta]

How can I bring both sounds data and videos data from gstreamer simultaneously?

Now I'm trying to implement some applications on 'unity' using inputs, sounds and videos, from 'gstreamer'. Specifically, what I'm trying to do is to bring sounds data and video data to 'unity' from 'gstreamer' by editing and using 'CustomPipelinePlayer.cs', which is in mrayGStreamerUnity/Unity/UnityTests/Assets/GStreamerUnity/Components/. I think I need to add a line, like bellow, to 'CustomPipelinePlayer.cs', but don't know how to treat the other parts.

gst-launch-1.0 filesrc location=0.mp4  ! qtdemux name=demux0  demux0.audio_0 ! queue ! decodebin ! audioconvert ! autoaudiosink demux0.video_0 ! queue ! h264parse ! msdkh264dec ! videoconvert ! autovideosink

I know this script was designed for inputting video data to 'unity', however, what I wanna realize is to bring both sounds data and video data at the same time. If there's any possible way to make it go well, please teach me how to address it!

[mrayy]

There is a component already addresses the load of file and playing its video and audio contents using the plugin. Please refer to FileVideoPlayer component: https://github.com/mrayy/mrayGStreamerUnity/blob/master/Unity/UnityTests/Assets/GStreamerUnity/Components/FileVideoPlayer.cs

[Hikaru-Furuta]

There is a component already addresses the load of file and playing its video and audio contents using the plugin. Please refer to FileVideoPlayer component: https://github.com/mrayy/mrayGStreamerUnity/blob/master/Unity/UnityTests/Assets/GStreamerUnity/Components/FileVideoPlayer.cs

thank you I'm gonna try that!