mlc-llm icon indicating copy to clipboard operation
mlc-llm copied to clipboard

[Model Request] gorilla-llm/gorilla-openfunctions-v2 (7B model with functional calling performance is On-par with GPT-4)

Open t83714 opened this issue 1 year ago • 1 comments

⚙️ Request New Models

  • Link to an existing implementation (e.g. Hugging Face/Github): https://huggingface.co/gorilla-llm/gorilla-openfunctions-v2
    • Why? With 7B size, the functional calling performance is On-par with GPT-4 See BFCL leaderboard
  • Is this model architecture supported by MLC-LLM? Yes. the config.json states LlamaForCausalLM

Additional context

t83714 avatar Aug 13 '24 13:08 t83714