core icon indicating copy to clipboard operation
core copied to clipboard

Wyoming successfully integrates whisper, but the entity is immediately and forever unavailable

Open jds11111 opened this issue 1 year ago • 9 comments

The problem

I have whisper running in a docker container on another machine. The logs show only INFO:__main__:Ready. I have uninstalled and reinstalled several times. I have deleted and reinstalled the wyoming integration for whisper several times. Each time wyoming recognizes and integrates my whisper installation. However, it then immediately reports the entity as unavailable, and it never returns. I have piper running on the same machine without any integration problems.

I have set the integration to debug logs, but no error shows up. The problem showed up on the preceding HA version (2023.05) and persists after updating to the latest (2023.06).

What version of Home Assistant Core has the issue?

core-2023.6.1

What was the last working version of Home Assistant Core?

core-2023.5

What type of installation are you running?

Home Assistant Container

Integration causing the issue

wyoming

Link to integration documentation on our website

https://www.home-assistant.io/integrations/wyoming

Diagnostics information

The only entry for wyoming is to show that the integration started up.

Example YAML snippet

No response

Anything in the logs that might be useful for us?

No response

Additional information

No response

jds11111 avatar Jun 13 '23 21:06 jds11111

Hey there @balloob, @synesthesiam, mind taking a look at this issue as it has been labeled with an integration (wyoming) you are listed as a code owner for? Thanks!

Code owner commands

Code owners of wyoming can trigger bot actions by commenting:

  • @home-assistant close Closes the issue.
  • @home-assistant rename Awesome new title Renames the issue.
  • @home-assistant reopen Reopen the issue.
  • @home-assistant unassign wyoming Removes the current integration label and assignees on the issue, add the integration domain after the command.

(message by CodeOwnersMention)


wyoming documentation wyoming source (message by IssueLinks)

home-assistant[bot] avatar Jun 13 '23 21:06 home-assistant[bot]

Having similar issue using HA Container and Whisper in Docker. It's not Unavaible though. The state shows as "Unknown."

guarddog13 avatar Jun 30 '23 16:06 guarddog13

In my HA OS installation stt.faster_whisper entity is always unknown.

paulius2k avatar Jul 07 '23 10:07 paulius2k

I am seeing this issue too Installation is Hassio on a Pi4

bsamarketing avatar Jul 17 '23 10:07 bsamarketing

I deleted everything, reinstalled the docker containers, and re-integrated in HA. It worked for a few days, and now fails again. I deleted the integration and tried to do it again, but no luck. I don't think that this thing is at all stable.

jds11111 avatar Aug 06 '23 14:08 jds11111

Same issue using the offical whisper add-on, HASSOS x86/x64 bare metal install. Has been like this forever, just always 'unknown'. Piper seems fine?

declan-wade avatar Oct 13 '23 14:10 declan-wade

I was looking into this and the best I can tell is when piper is called through homeassistant.components.wyoming.tts.WyomingTtsProvider.async_get_tts_audio the class WyomingTtsProvider has a base class of TextToSpeechEntity from homeassistant.components.tts which bounces around a few functions but inevitably calls internal_async_get_tts_audio which updates the state.

However, when faster-whisper is called through wyoming at homeassistant.components.wyoming.stt.WyomingSttProvider.async_process_audio_stream nothing is run from the inherited class SpeechToTextEntity from homeassistant.components.stt and the function internal_async_process_audio_stream is never run so no update takes place.

extant1 avatar Oct 28 '23 20:10 extant1

This is still an issue that prevents all the voice workflow from working, I would say this is a critical issue.

edurenye avatar Jan 10 '24 09:01 edurenye

any updates ?

koalabamu avatar Feb 25 '24 19:02 koalabamu

@balloob @synesthesiam - Still seeing this - exactly as op described. Running docker with latest HA. Have tried putting whisper and piper on another host running docker to make sure this was not some kind of loopback/docker networking issue. Still the same. Add the integration and boom, immediately unavailable even though it added the whisper integration.

vexter0944 avatar Mar 13 '24 01:03 vexter0944

There hasn't been any activity on this issue recently. Due to the high number of incoming GitHub notifications, we have to clean some of the old issues, as many of them have already been resolved with the latest updates. Please make sure to update to the latest Home Assistant version and check if that solves the issue. Let us know if that works for you by adding a comment 👍 This issue has now been marked as stale and will be closed if no further activity occurs. Thank you for your contributions.