farfalle icon indicating copy to clipboard operation
farfalle copied to clipboard

500: 'Message' object has no attribute 'tool_calls'

Open anzestrela opened this issue 8 months ago • 1 comments

I am running a slightly modified version of farfalle, to be able to use a custom OpenAI compatable API I changed llm.llm = LiteLLM(model=llm.llm.model) to llm.llm = LiteLLM(model=llm.llm.model, api_base="http://192.168.73.78:5000/v1") it generates the answer but when trying to generate related_queries it errors with: 500: 'Message' object has no attribute 'tool_calls' I know that the version of llama3-8b I am using supports function calling, as it is working with openwebUI.

anzestrela avatar Jun 27 '24 09:06 anzestrela