wit icon indicating copy to clipboard operation
wit copied to clipboard

Wit App returns confidence level for a sentences that is not trained

Open TaraNaser opened this issue 4 years ago • 5 comments

Do you want to request a feature, report a bug, or ask a question about wit? bug What is the current behavior? Wit App returns confidence level for a sentences that is not trained Using API https://api.wit.ai/message?n=8&v=20190904&q=عبدالرحيم عليان The api returns intent even though the sentence was not trained in any intent image

If the current behavior is a bug, please provide the steps to reproduce and if possible a minimal demo of the problem. test using API https://api.wit.ai/message?n=8&v=20190904&q=عبدالرحيم عليان What is the expected behavior? To not understand If applicable, what is the App ID where you are experiencing this issue? If you do not provide this, we cannot help. 315538893568231

TaraNaser avatar Sep 23 '21 14:09 TaraNaser

Hello @TaraNaser! It's expected to get some results back even on untrained utterances, as long as the model can find some matches. The confidence value indicates how close the match is.

nishsinghal20 avatar Sep 23 '21 19:09 nishsinghal20

Hi @nishsinghal20 the trained utterances under the first intent are not similar or close to the sentence, but the confidence level is still high.

TaraNaser avatar Sep 24 '21 12:09 TaraNaser

@TaraNaser Do you consistently see the same response for that utterances, or was it just once? Could you try another similar utterances and see if you still get similar response and confidence scores back? You can also try training your model with a larger sample of utterances to improve it's prediction accuracy.

nishsinghal20 avatar Sep 24 '21 17:09 nishsinghal20

Hi @nishsinghal20 I get the same response for that sentence all the time. This sentence is not trained under any intent. similar sentences give back the same intent but a lower confidence level. For example: image

TaraNaser avatar Sep 28 '21 07:09 TaraNaser

Hello @TaraNaser! Apologies for the late reply. One thing you can do is to annotate your utterances as "Out of scope" image

nishsinghal20 avatar Oct 25 '21 23:10 nishsinghal20

Closing due to no movement on the issue. Please re-open or file a new task should the issue be persisting.

Barbog avatar Apr 18 '23 10:04 Barbog