CopilotKit icon indicating copy to clipboard operation
CopilotKit copied to clipboard

feat(react-ui): updated speech to text functionality

Open larsenweigle opened this issue 8 months ago • 8 comments

What does this PR do?

Enhancements to transcribeAudioUrl and textToSpeechUrl Functionality in CopilotKit

This update improves how transcribeAudioUrl and textToSpeechUrl properties are handled in CopilotKit, making the speech-to-text functionality for prebuilt components more flexible and fixing a UI issue with the microphone icon.

Changes:

  1. Improved Property Behavior: Previously, both transcribeAudioUrl and textToSpeechUrl had to be specified for speech-to-text functionality to work in prebuilt components. Now, users can enable this feature by specifying only transcribeAudioUrl, if desired.
  2. Microphone Icon Rendering Fix: A styling issue caused the microphone icon to not render when both transcribeAudioUrl and textToSpeechUrl properties were set, even though the button remained clickable. This update fixes the CSS to ensure the microphone icon displays correctly in prebuilt components (see attached image below).
Screenshot 2025-03-09 at 10 39 56 PM

larsenweigle avatar Mar 10 '25 05:03 larsenweigle

@larsenweigle is attempting to deploy a commit to the CopilotKit Team on Vercel.

A member of the Team first needs to authorize it.

vercel[bot] avatar Mar 10 '25 05:03 vercel[bot]

Deploy Preview for marvelous-hummingbird-aff393 ready!

Name Link
Latest commit cdd3fb36bdcb53155d4f6579eacad741b36354f3
Latest deploy log https://app.netlify.com/sites/marvelous-hummingbird-aff393/deploys/67ce7c7d449a24000905865d
Deploy Preview https://deploy-preview-1462--marvelous-hummingbird-aff393.netlify.app
Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

netlify[bot] avatar Mar 10 '25 05:03 netlify[bot]

When is this feature going to be released?

alzin avatar Mar 21 '25 16:03 alzin

Hi @larsenweigle! Thanks for the contribution this is awesome. Would you mind rebasing against main? At that point I'll approve the workflows to run.

tylerslaton avatar Mar 21 '25 20:03 tylerslaton

@tylerslaton done!

larsenweigle avatar Mar 21 '25 20:03 larsenweigle

Only failure that matters here is Prettier failing. Mind fixing that up @larsenweigle?

The rest of the failures are just related to previews, which we don't deploy for community PRs.

tylerslaton avatar Mar 24 '25 15:03 tylerslaton

⏭️ Changeset Not Required

Latest commit: 5f20f8c5c959bdc0827665e8be21b696893faa61

No changes in this PR affected the @copilitkit/* packages. Merging this PR will not cause a version bump for any packages.

Changeset is not required for this PR.

done @tylerslaton

larsenweigle avatar Mar 24 '25 17:03 larsenweigle