[Feature request] Support loading GGUF and GGML model format

[nghidinhit]

[merrymercy]

Community contributions are welcome

[digisomni]

Does this work via SGLang? If not, I think we should just push support for it through there instead of the native model runner here?

[surak]

@digisomni If you would add new functionality, it would be nice to have first on the default worker.

[02shanks]

@surak @merrymercy is this still open for contribution?

[surak]

Absolutely!