woodswift
woodswift
> Can you confirm if `Mistral-7B-OpenOrca` supports function call format in its prompt template? To enable function all, the model itself needs to support/fine-tuned with function call format as well....
I finally got myself unblocked by using the class `CustomModelClientWithArguments`. However, tool calling was not successful, and my best guess was that `Mistral-7B-OpenOrca` was not finetuned for tool calling task....
> I posted this issue to our Discord channel to see if there are some there that can help. https://discord.com/channels/1153072414184452236/1201369716057440287 Thank you! But I am seeing nothing after clicking the...
> @woodswift recently mistral model have started to support tool call. Have you checked? https://docs.mistral.ai/api/#operation/createChatCompletion Oh, thank you for sharing! I have not tried it yet, so will do shortly...
I am using langserve==0.0.46 but gets the same AssertionError: No run_id found for the given run. The traceback message indicates that: - It is due to line 733 in api_handler.py...