local-llm-function-calling

local-llm-function-calling copied to clipboard

Benchmark data

1

Any plans on providing benchmarks w/ the top OSS models like Mistral 7b using this as well as benchmarks against fine-tuned models.

paulpierre

can this be used for function calling with other opensource models?

7

Hi just found this repo really interesting. I am wondering if this can be used for function calling task with other models like Llama2, falcon, vicuna, PaLm or else. Model...

OnlinePage

Problems when trying to use Llama-2 models for function calling

2

When I run the following command: generator = Generator.hf(functions, "meta-llama/Llama-2-7b-chat-hf") I get the following error: --------------------------------------------------------------------------- AttributeError Traceback (most recent call last) Cell In[11], line 1 ----> 1 function_call =...

nmm001001

can I use this with my own fine tuned models on lm studio?

JustSomeDemon