amazon-chime-sdk-js icon indicating copy to clipboard operation
amazon-chime-sdk-js copied to clipboard

Black video in active speaker artifacts

Open razorxan opened this issue 2 years ago • 7 comments

What happened and what did you expect to happen?

The app we developed is using CreateMediaCapturePipelineCommand to record the audio/video streams the meeting sessions.

the configurations of the pipeline are:

ChimeSdkMeetingConfiguration: {
    ArtifactsConfiguration: {
        Audio: {
            MuxType: 'AudioWithActiveSpeakerVideo'
        },
        Video: {
            State: 'Enabled',
            MuxType: 'VideoOnly'
        },
        Content: {
            State: 'Enabled',
            MuxType: 'ContentOnly'
        }
    }
}

The attendees in the meeting see and hear eachother, nevertheless the active speaker artifacts (in the audio path of the sink s3 bucket), are BLACK VIDEOS with audible audio.Seems like the active speaker is not detected, at least , his video stream is not attached to the active-speaker mp4 chunk.

Videos artifacts (video only) of the individual attendees, are correctly showing video content.

Have you reviewed our existing documentation?

Reproduction steps

Once created a chime meeting with the @aws-sdk/client-chime, I just create a pipeline like so

await chime.send(new CreateMediaCapturePipelineCommand({
    SourceType: 'ChimeSdkMeeting',
    SinkType: "S3Bucket",
    SinkArn: `arn:aws:s3:::${bucket_name}/${code}/recordings/${+Date.now()}--${meeting.Meeting.MeetingId}`,
    SourceArn: `arn:aws:chime::XXXXXXXXXX:meeting:${meeting.Meeting.MeetingId}`,
    ChimeSdkMeetingConfiguration: {
        ArtifactsConfiguration: {
            Audio: {
                MuxType: 'AudioWithActiveSpeakerVideo'
            },
            Video: {
                State: 'Enabled',
                MuxType: 'VideoOnly'
            },
            Content: {
                State: 'Enabled',
                MuxType: 'ContentOnly'
            }
        }
    }
}));

Amazon Chime SDK for JavaScript version

amazon-chime-sdk-js version 3, @aws-sdk/client-chime version 3.36.1

What browsers are you seeing the problem on?

Chrome

Browser version

Version 108.0.5359.98 (Official Build) (x86_64)

Meeting and Attendee ID Information.

PipelineId: 1abe7502-02d2-4a5a-b02a-33da2af2e47d MeetingId: a80dcde3-d4dd-41e0-86b4-18b91b3e0706

Browser console logs

Not available

razorxan avatar Dec 15 '22 15:12 razorxan