mediacapture-transform
mediacapture-transform copied to clipboard
w3c
MediaStreamTrack Insertable Media Processing using Streams
As per https://github.com/w3c/mediacapture-main/issues/984, review mute/unmute/ended and constraints on new VideoTrackGenerator().track. Mute/unmute is controlled by VideoTrackGenerator's [muted](https://w3c.github.io/mediacapture-transform/#dom-videotrackgenerator-muted) attribute. The track is ended when the [writable is closed](https://w3c.github.io/mediacapture-transform/#closewritable) (nit: the "end" link...
Extracting this discussion from https://github.com/w3c/mediacapture-transform/issues/4, since this was not really fully discussed there. The use cases for MediaStreamTrackProcessor for audio are unclear given its functionality largely overlaps with what WebAudio...
Should we document in the spec that there is no consensus on whether supporting MediaStreamTrackProcessor for audio?
VideoTrackGenerator enqueues VideoFrame objects which have a timestamp. As per existing WPT tests, timestamps are expected to be preserved when doing VideoTrackGenerator->MediaStreamTrackProcessor. This would mean that a web application is...
The spec says: ``` If init.[track](https://w3c.github.io/mediacapture-transform/#dom-mediastreamtrackprocessorinit-track) is not a valid [MediaStreamTrack](https://www.w3.org/TR/mediacapture-streams/#dom-mediastreamtrack), throw a [TypeError](https://webidl.spec.whatwg.org/#exceptiondef-typeerror). ``` But a valid MediaStreamTrack is not defined. Is it that this should be a video...
It is unclear when applyConstraints is expected to succeed. The spec seems to indicate that any width/height/frameRate that are in the capabilities range should be good. But the capabilities is...
See ongoing effort to add a owning stream type (https://github.com/whatwg/streams/pull/1271 and related). Moving to an owning WritableStream would make the intent clearer and the spec simpler (in particular this would...
A transform exposes video frames that can be of various pixel formats (https://w3c.github.io/webcodecs/#enumdef-videopixelformat). Depending on the OS and/or camera, this might be I420 or NV12 right now for cameras. This...
MediaStreamTrackProcessor usefulness is very limited. It also does not match VideoTrackGenerator. First MediaStreamTrackProcessor name is agnostic of audio vs. video which is not great with regards to the debate on...
This is an overall tracking issue for timing-related issues in mediacapture-transform. Questions: 1. What timing information is provided by various sources (capture, canvas, etc.) 2. What VideoFrame/AudioData attributes correspond to...
