Hallucinations when using web search

[NasonZ]

I have tried to run a mistral model with the search api but the web results don't seem to be making it to the model.

I'm hosting the model through text-gen-webui and encountering the exact same issue as #571.

I've given it a go with openhermes-2.5-mistral-7b.Q5_K_M.gguf, it seems to use the search tool just fine but fails to incorporate the results into its answer.

Any idea how to fix this issue or at least how I could help with debugging.

[iChristGit]

If you try llamacpp it will work fine, its something with Text-gen-webui specifically, hopefully devs will find out why.

[rrfaria]

I had same issue today only using huggingface Chat

model

mistralai/Mixtral-8x7B-Instruct-v0.1

my prompt

What is itsa4(itausa) price right now

Sites used on this search is ok but looks like websearch is not extracting correct info from thoses sites.

the correct answer should be this (R$10.38):