mlc-llm icon indicating copy to clipboard operation
mlc-llm copied to clipboard

Published 20 hours ago • verified publisher icon mlc-ai

[Model Request] Firefunction V1

Open Sing-Li opened this issue 10 months ago • 2 comments

⚙️ Request New Models

  • Link to an existing implementation (e.g. Hugging Face/Github): https://huggingface.co/fireworks-ai/firefunction-v1
  • Is this model architecture supported by MLC-LLM? (Yes - thx @Hzfengsy ! Mixtral)

Additional context

Currently one of the field-proven better performing function calling models around.

Sing-Li avatar Apr 10 '24 16:04 Sing-Li

It is based on Mixtral, so MLC-LLM should work well :)

We can upload the weight if possible

Hzfengsy avatar Apr 11 '24 07:04 Hzfengsy

That's awesome! @Hzfengsy Looking forward to it -- together with many others in the community (I'm quite sure) :pray:

Sing-Li avatar Apr 11 '24 18:04 Sing-Li