tue_robocup icon indicating copy to clipboard operation
tue_robocup copied to clipboard

[Intermittent:] Dragonfly (the infamous speech bug)

Open ar13pit opened this issue 6 years ago • 6 comments
trafficstars

Apart from the issues of HMI server, the bug is in our server interface of dragonfly speech recognition. The preempts are not being done correctly and a new request is overwriting the grammar before completion of the existing one.

ar13pit avatar Jul 11 '19 15:07 ar13pit

https://github.com/tue-robotics/dragonfly_speech_recognition/issues/14

MatthijsBurgh avatar Jul 12 '19 07:07 MatthijsBurgh

The famous dragonfly bug where grammars can't be unloaded :(

Rayman avatar Jul 12 '19 09:07 Rayman

The famous dragonfly bug where grammars can't be unloaded :(

Is it a bug in dragonfly itself? We could switch to a new version, https://github.com/tue-robotics/dragonfly_speech_recognition/issues/26, this could solve it, if it is in dragonfly.

MatthijsBurgh avatar Jul 12 '19 09:07 MatthijsBurgh

Dragonfly has COM bindings to the underlying windows speech service. Even when you unload the grammers, you still receive callbacks when things are heared by the WSR engine. Maybe this behavior is fixed in the new version?

Rayman avatar Jul 12 '19 09:07 Rayman

Maybe using a different engine, kaldi or dragon fixes it.

Rayman avatar Jul 12 '19 09:07 Rayman

We could try with the new dragonfly and see if it is fixed.

DNS maybe a good alternative.

For Kaldi, we won't use dragonfly as we have already built our custom grammar loading and unloading functionality and it works. The only thing remaining in it is our customized model inference pipeline which needs a bit of work.

ar13pit avatar Jul 12 '19 10:07 ar13pit