llama-stack icon indicating copy to clipboard operation
llama-stack copied to clipboard

LLM hallucinating while tool calling

Open cheesecake100201 opened this issue 1 year ago • 1 comments

image The tool call shows something called as brary search which neither I have passed nor exists. I have only passed inbuilt tools which are brave_Search, wolfram alpha and code interpreter. I am using the llama-3.1-405b-instruct model for testing through the fireworks inference API. I have added debug statements to check the tools being passed before and after the chat completion API is called and it shows that the tools being passed are accurate and as in the jupyter notebook.

cheesecake100201 avatar Sep 27 '24 05:09 cheesecake100201