mlc-llm icon indicating copy to clipboard operation
mlc-llm copied to clipboard

[SLM] Introduce microsoft/Phi-3

Open mengshyu opened this issue 10 months ago • 2 comments

Introduce microsoft/Phi-3 from https://huggingface.co/microsoft/Phi-3-mini-4k-instruct

cc. @CharlieFRuan @MasterJH5574 @tqchen

mengshyu avatar Apr 25 '24 18:04 mengshyu

Why did this jenkins merge fail?

sebastienbo avatar Apr 28 '24 13:04 sebastienbo

waiting

moondiy avatar May 01 '24 04:05 moondiy

waiting

How will existing Android users be able to use it? Reinstall existing Android app or can we refresh the list of existing models?

sebastienbo avatar May 07 '24 16:05 sebastienbo

Hi @moondiy @sebastienbo, our prebuilt package should be able to contain this commit tomorrow. We will work on uploading prebuilt model weights to our huggingface and also the android app update. Will report back regarding the progress.

MasterJH5574 avatar May 07 '24 23:05 MasterJH5574

I see there are chunks available for Phi 3:

https://huggingface.co/mlc-ai/Phi-3-mini-4k-instruct-q4f16_2-MLC/tree/main

.. but I couldn't find a corresponding .wasm file (yet)?

https://github.com/mlc-ai/binary-mlc-llm-libs

// Doh, wrong sub-project, sorry

flatsiedatsie avatar May 17 '24 11:05 flatsiedatsie

Thanks. So we just download a new APK?

On Wed, 8 May 2024, 01:37 Ruihang Lai, @.***> wrote:

Hi @moondiy https://github.com/moondiy @sebastienbo https://github.com/sebastienbo, our prebuilt package should be able to contain this commit tomorrow. We will work on uploading prebuilt model weights to our huggingface and also the android app update. Will report back regarding the progress.

— Reply to this email directly, view it on GitHub https://github.com/mlc-ai/mlc-llm/pull/2222#issuecomment-2099476972, or unsubscribe https://github.com/notifications/unsubscribe-auth/AB7MPQSRE3CQD4ZR7OX5SXLZBFQSFAVCNFSM6AAAAABGZM7V4SVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAOJZGQ3TMOJXGI . You are receiving this because you were mentioned.Message ID: @.***>

sebastienbo avatar May 17 '24 11:05 sebastienbo