sandstone
sandstone copied to clipboard
WRQ-5388: [POC] Input with useWhisper API
Checklist
- [x] I have read and understand the contribution guide
- [ ] A CHANGELOG entry is included
- [ ] At least one test case is included for this feature or bug fix
- [x] Documentation was added or is not needed
- [ ] This is an API breaking change
Issue Resolved / Feature Added
useWhisper is a React Hook for OpenAI Whisper API with speech recorder, real-time transcription and silence removal built-in. We'd like to research if we can adopt this hook into the Enact Input component.
Resolution
Made a demo on Sandston sampler Input. If you click the mic button, recording starts and trascript text displays in input every 20 seconds.
Additional Considerations
This requires useWhisper API, OpenAI API Key, and OpenAI Endpoint. Editing transcript text has not been developed properly yet. Should choose just one of key input or transcribing for now. It will be nice to enable editing transcript text later.
Links
WRQ-5388
Comments
Enact-DCO-1.0-Signed-off-by: Jiye Kim ([email protected])