Please support HuggingFaceH4/starchat-alpha

[localagi]

https://huggingface.co/HuggingFaceH4/starchat-alpha fails with issue not supported, bc it's https://huggingface.co/docs/transformers/model_doc/gpt_bigcode

[localagi]

There is so many different models out there - how can i tweak the input to generate other models? Do we need any libraries to plugged in?

[CharlieFRuan]

Hi @localagi, if the model you are interested in has architecture supported by MLC-LLM, but the model itself is not explicitly supported, you can follow the tutorial Distribute Compiled Model to compile it yourself.

If the model's architecture is not supported by MLC-LLM yet, it is also possible to add it yourself with the guide here. Though this is much more involved.

[tqchen]

closing for now due to inactive status, we will prioritize latest models