Rohit Sharma comments

Results 4 comments of


                                            Rohit Sharma

AI-Proxy plugin: "An unexpected error occurred" when upstream URL is missing port/path

Hey @Water-Melon, I don't have access to Kong JIRA. How can I get updates on [KAG-4312](https://konghq.atlassian.net/browse/KAG-4312)? I am also facing same issue with self hosted llama2 model [KAG-4312]: https://konghq.atlassian.net/browse/KAG-4312?atlOrigin=eyJpIjoiNWRkNTljNzYxNjVmNDY3MDlhMDU5Y2ZhYzA5YTRkZjUiLCJwIjoiZ2l0aHViLWNvbS1KU1cifQ

Making searching docs as a default option to reduce hallucinations

Hello, I am facing the same issue with the ollama with the llama2 model. So, the search works fine. However, the chat backend is not replying from the sources. Is...

Making searching docs as a default option to reduce hallucinations

Hey, @yuhongsun96, I'm Just checking up on it to see if you are able to update those changes. I would like to redeploy and test again.

Making searching docs as a default option to reduce hallucinations

Hey @yuhongsun96 , After enabling `DISABLE_LLM_CHOOSE_SEARCH=True`, this property in the config is working for me. I will continue with my test from here. Thank you for pointing me to the...