mlc-llm
mlc-llm copied to clipboard
[SLM] Introduce microsoft/Phi-3
Introduce microsoft/Phi-3 from https://huggingface.co/microsoft/Phi-3-mini-4k-instruct
cc. @CharlieFRuan @MasterJH5574 @tqchen
Why did this jenkins merge fail?
waiting
waiting
How will existing Android users be able to use it? Reinstall existing Android app or can we refresh the list of existing models?
Hi @moondiy @sebastienbo, our prebuilt package should be able to contain this commit tomorrow. We will work on uploading prebuilt model weights to our huggingface and also the android app update. Will report back regarding the progress.
I see there are chunks available for Phi 3:
https://huggingface.co/mlc-ai/Phi-3-mini-4k-instruct-q4f16_2-MLC/tree/main
.. but I couldn't find a corresponding .wasm file (yet)?
https://github.com/mlc-ai/binary-mlc-llm-libs
// Doh, wrong sub-project, sorry
Thanks. So we just download a new APK?
On Wed, 8 May 2024, 01:37 Ruihang Lai, @.***> wrote:
Hi @moondiy https://github.com/moondiy @sebastienbo https://github.com/sebastienbo, our prebuilt package should be able to contain this commit tomorrow. We will work on uploading prebuilt model weights to our huggingface and also the android app update. Will report back regarding the progress.
— Reply to this email directly, view it on GitHub https://github.com/mlc-ai/mlc-llm/pull/2222#issuecomment-2099476972, or unsubscribe https://github.com/notifications/unsubscribe-auth/AB7MPQSRE3CQD4ZR7OX5SXLZBFQSFAVCNFSM6AAAAABGZM7V4SVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAOJZGQ3TMOJXGI . You are receiving this because you were mentioned.Message ID: @.***>