AWS Chime iOS App sharing screen and playing video does not transfer audio of the video played

[C0der-Bee]

We integrated AWS Chime SDK in one of our iOS App. Using that we are able to make Video Calls and able to share screens as well. However, while sharing the screen if we play a video on my screen other users can only see it but they cannot hear it.

This feature is not yet implemented in AWS Chime. But this is causing a lot of trouble.

@zhinang-amazon

The only reason we built that app was for our customers to be able to do remote meetings and do presentations by sharing their screens.

[hokyungh]

@richa2jan This is the feature that is not yet in place. I'll add enhancement and update this ticket once we have this feature out.

[C0der-Bee]

Is no one assigned to this enhancement? Just asking.

[hokyungh]

Hi @richa2jan, we don't usually assign it in the GitHub, but if there is update, we usually put it in the same thread.

[C0der-Bee]

Thanks for responding

[jjaaxx44]

I'm also looking for the same implementation. would be great addition in demo app. I was looking for option like audio loopback, but no luck. waiting for update :)

[C0der-Bee]

I am surprised that no one is assigned to this issue yet. Its been 8 months since I raised it. I wish I had opted for Zoom. Very unsatisfied with Chime and its support team. There is hardly any progress on feature requests.

[zhinang-amazon]

Hi, apologies on your experience. Our team is currently undertaking a significant project to align our end to end audio processing pipeline with WebRTC protocols and enable features such like injectable audio and a secondary content share audio sending stream. At the same time, we want to make sure that we maintain and improve the audio quality. We will keep this ticket open until we add support for Content Share Audio. In the meantime, since we support this in the JS SDK, have you explored embedding a WebView to enable this?

Here is our WKWebView demo with JS SDK: https://github.com/aws-samples/amazon-chime-sdk/tree/main/apps/iOS-WKWebView-sample Keep in mind that that demo does not have content share functionality implemented, and you would have to figure out how to convert your content audio video data into the MediaStream object that is required by the JS SDK API.

[cHaLkdusT]

哈喽 @zhinang-amazon, @ziyiz-amzn, do we have an estimate date to implement this feature? Thanks!

[zhinang-amazon]

Hi @cHaLkdusT, we are still working on a pre-requisite project of this feature, and do not have an estimate date for this feature yet, apologies.

[ashirkhan94]

Hi @zhinang-amazon

Any update on this feature. We also need the Audio stream from mic for Transcript like #509 . We implemented it with one third party library (react-native-live-audio-stream), but it also capture the meeting audio from speaker (audio of remote attendee) , we need to transcribe only the self audio not the remote audio, I think the issue happen because of two AudioSessions, one is SDK's AudioSession and the AudioSession of package.

I think the upcoming feature is useful for transcript.

Thanks

[ashirkhan94]

Hi @zhinang-amazon Any update? or Do you have any idea about how to handle 2 audio sessions in a single meeting without mix and duck audio, like Ecco cancellation? thanks

[ashirkhan94]

Hi @hokyungh Any update? We are still stuck on this issue

[ashirkhan94]

Hi @zhinang-amazon Any update?

[ashirkhan94]

Hi @georgezy-amzn Any update?

[ashirkhan94]

Hi team Any update?

[yochum]

Hi @ashirkhan94, We don't have any updates for you at this time. I encourage you to open up an AWS support case to track this request.

[tomlson2]

Any update on this? We can now capture WebRTC audio via Kinesis but when will we be able to inject audio without a browser?