Telling it to check if something is on turns it on

[Andrei-Iosifescu123]

I have the latest beta installed with the default settings. Every time I tell it to "check if x is on", it turns x on, then says that x is currently off, which is not true. Sometimes it says Something went wrong: Unable to find service switch.get and sometimes even telling it to check if x is off turns x on. This is really annoying as I can't use a voice assistant without checking if it did something it wasn't supposed to do.

[jekalmin]

Thanks for reporting an issue!

This also happens to me, and it's not easy to get it work perfectly. There are few things we can try.

1. Tweak prompt and function definitions
   • Although I tried gpt not to do (turn on light when I check so, it didn't work. Probably I have to build prompt from ground up again to come up with better prompt.
2. Wait for a new smarter model to be released.
   • A new model (gpt-3.5-turbo-0125) will be released soon. Hope that it's fixed.

Contribution to prompts and functions are welcome.

[Andrei-Iosifescu123]

Thanks for reporting an issue!

This also happens to me, and it's not easy to get it work perfectly. There are few things we can try.

1. Tweak prompt and function definitions

   • Although I tried gpt not to do (turn on light when I check so, it didn't work. Probably I have to build prompt from ground up again to come up with better prompt.

2. Wait for a new smarter model to be released.

   • A new model (gpt-3.5-turbo-0125) will be released soon. Hope that it's fixed.

Contribution to prompts and functions are welcome.

I now use gpt-4-turbo-preview and it is much better with no mistakes like this, but it is more expensive.

[jekalmin]

That's another way!

It seems gpt-3.5-turbo-0125 is now available. Let's try it.

[mateuszdrab]

I experienced that myself, since I'm using Azure - I'll need to wait a bit for that model to become available.

Another annoying thing is no matter how much I tell it not to execute services to get state of things, it initially tries to do so: Something went wrong: Service sensor.get_state not found.. Then, out of nowhere it starts to work fine and answers questions from the states table.

[jekalmin]

@mateuszdrab

Sorry for late reply. It happened me when using 3.5. Have you tried gpt-4o-mini?

[mateuszdrab]

@mateuszdrab

Sorry for late reply. It happened me when using 3.5. Have you tried gpt-4o-mini?

Hey, not been using it lately because my satellites were too unreliable and lack of hardware acceleration for Whisper means it takes forever.

I'll give you some feedback soonish when I start using it more often.