element-call icon indicating copy to clipboard operation
element-call copied to clipboard

Published 20 hours ago • verified publisher icon element-hq

Figure out a saner way to route audio

Open SimonBrandner opened this issue 3 years ago • 3 comments

Context: discussions on https://github.com/vector-im/element-call/pull/512

image

SimonBrandner avatar Aug 16 '22 08:08 SimonBrandner

If we decide to always use the Web Audio API, we could then always route everyone's audio ~~to a single hidden audio element~~ directly to the destination, which would be pretty clean IMO

robintown avatar Aug 16 '22 11:08 robintown

If we decide to always use the Web Audio API, we could then always route everyone's audio to a single hidden audio element, which would be pretty clean IMO

That, we are actually doing already :p

SimonBrandner avatar Aug 16 '22 12:08 SimonBrandner

My reasoning for not using Web Audio for everything was that the Chrome AEC hack wastes CPU cycles, so it would be good to avoid where possible. (And possibly, spinning up an audio processing chain with no effects might waste resources a little bit too.) However, that could be sacrificed in favor of having a more maintainable model for audio routing.

robintown avatar Aug 16 '22 12:08 robintown