WatchOS text-to-speech-failed

[miumer]

iOS device model, version and app version

Model Name: Apple watch Ultra Software Version: watchOS 10.6.1; iOS 17.6.1 App version: 2024.8.1

Home Assistant Core Version 2024.6.2

When opening Assist in my apple watch it is very unreliable with speech-to-text and answers. Sometimes it thinks for a very long time, then gives a red message: "speech-to-text failed", but then still prints underneath the text i spoke, so it seems it actually didn't fail. Sometimes nothing happens after that--no answer, but then sometimes when exactly the same thing is displayed: "speech-to-text failed" it does answer to the question so for some reason it only works sometimes but bugs out with "speech-to-text failed" most of the time. Everything works on iphone. All widgets and going to assist through the app etc. In the screenshots below i actually got an answer once after the "speech-to-text failed" and then my question registered.

To Reproduce Im using "extended OpenAI Conversation" addon for Openai integration as the conversation agent to Home Assistant. To reproduce add this conversation agent to a new Assist Pipeline and run the Assist app on your watch watch asking something about a sensor that has been exposed to the voice assistants.

Expected behavior Assist asnwers the same way my iphone does with the "Assist in App" widget for example

Screenshots