react-transcript-editor icon indicating copy to clipboard operation
react-transcript-editor copied to clipboard

Integrate bbc/peaks.js for waveform display

Open NickRuiz opened this issue 5 years ago • 4 comments

Is your feature request related to a problem? Please describe. Sometimes when transcribing long audio files there are long pauses. From an ASR (STT) standpoint, no speech regions may be detected, but there may be a muffled word that was missed. A quick view of the waveform can help pick out audio regions to listen to.

Describe the solution you'd like Toggle display of the waveform below the time bar

Describe alternatives you've considered Separate waveforms per audio channel would be great.

Additional context

NickRuiz avatar Nov 07 '19 22:11 NickRuiz

👋 @NickRuiz

Throwing another option into the mix,

Replace the progress bar / or have an alternative progress bar in storybook using wavesurfer-js

The issue I see with using peak.js (and might be wrong coz I am not super familiar with the library) is that it says in the README:

Peaks.js was developed by BBC R&D to allow users to make accurate clippings of audio content in the browser, using a backend API that serves the waveform data.

And if it does need a backend to generate the waveform data it would make it harder to keep it self contained as part of the component.

pietrop avatar Nov 08 '19 10:11 pietrop

Good point. Thanks for sharing a few more-compatible alternatives.

NickRuiz avatar Nov 08 '19 14:11 NickRuiz

@NickRuiz I thought you might find this interesting / useful bbc/stt-align-node if you are looking for a way to review results of STT?

Click load demo- pietrop/stt-align-node in the example page.

Out of curiosity what is your main use case for the TranscriptEditor component ?

pietrop avatar Nov 18 '19 13:11 pietrop

Our transcribers/annotators use waveform display to quickly find the beginning of new "paragraphs", etc. Depending on how the ASR transcript is generated/segmented it might not be apparent when two adjacent words are separated by a long period of silence.

NickRuiz avatar Nov 18 '19 18:11 NickRuiz