com.unity.webrtc icon indicating copy to clipboard operation
com.unity.webrtc copied to clipboard

[REQUEST] Direct access to Nvenc encoding

Open sipsorcery opened this issue 5 years ago • 5 comments

Is there any chance the Unity webrtc package could expose direct access to the NVenc video encoder? The idea being that other WebRTC and VoIP implementations could then take advantage of it.

Some WebRTC use cases require different signalling mechanisms (or in the case of VoIP completely different protocols) or for differences to the way libwebrtc does things (e.g. enable private IP addresses). Other .NET based implementations can be used in Unity right now but the video, and to a lesser extent, audio encoding is never going to be that great without the hardware encoders.

Ideally a C# API would be nice but failing that even a documented, supported C++ API that could be used with PInvoke would be good.

sipsorcery avatar Oct 03 '20 18:10 sipsorcery

Totally Agree! Exposing NVec|VP8|VP9|H264 Encoder|Decoders can benefit other projects not directly related to Unity's WebRTC implementation.

rafcsoares avatar Oct 06 '20 18:10 rafcsoares

@rafcsoares, @sipsorcery My understanding that providing managed API for encoding/decoding using HWA, is it right?

karasusan avatar Jan 18 '22 02:01 karasusan

My understanding that providing managed API for encoding/decoding using HWA, is it right?

Yes, that would be very helpful.

sipsorcery avatar Jan 18 '22 09:01 sipsorcery

@sipsorcery I understood. This idea is great. I guess creating the different package for HWA codec would be better. I will discuss about the idea with my team. Thanks.

karasusan avatar Jan 19 '22 01:01 karasusan

@sipsorcery I understood. This idea is great. I guess creating the different package for HWA codec would be better. I will discuss about the idea with my team. Thanks.

It will be very useful~

haoqc86 avatar Feb 15 '22 09:02 haoqc86