sandstone icon indicating copy to clipboard operation
sandstone copied to clipboard

WRQ-5388: [POC] Input with useWhisper API

Open vJIYEv opened this issue 8 months ago • 1 comments

Checklist

  • [x] I have read and understand the contribution guide
  • [ ] A CHANGELOG entry is included
  • [ ] At least one test case is included for this feature or bug fix
  • [x] Documentation was added or is not needed
  • [ ] This is an API breaking change

Issue Resolved / Feature Added

useWhisper is a React Hook for OpenAI Whisper API with speech recorder, real-time transcription and silence removal built-in. We'd like to research if we can adopt this hook into the Enact Input component.

Resolution

Made a demo on Sandston sampler Input. If you click the mic button, recording starts and trascript text displays in input every 20 seconds.

Additional Considerations

This requires useWhisper API, OpenAI API Key, and OpenAI Endpoint. Editing transcript text has not been developed properly yet. Should choose just one of key input or transcribing for now. It will be nice to enable editing transcript text later.

Links

WRQ-5388

Comments

Enact-DCO-1.0-Signed-off-by: Jiye Kim ([email protected])

vJIYEv avatar Jun 14 '24 03:06 vJIYEv