mlc-llm icon indicating copy to clipboard operation
mlc-llm copied to clipboard

[Model Request] Guanaco

Open rndompc opened this issue 2 years ago • 0 comments

⚙️ Request New Models

  • Link to an existing implementation (e.g. Hugging Face/Github): https://huggingface.co/TheBloke/guanaco-33B-GGML
  • Is this model architecture supported by MLC-LLM? (the list of supported models) Yes

Additional context

This model have shown good performance within the Llama model. I would like to test it in different hardware. I also would appreciate If you can give me some recommendations about how to compile for a GPU Target: gfx90a.

rndompc avatar Jun 06 '23 17:06 rndompc