llama-cpp-python icon indicating copy to clipboard operation
llama-cpp-python copied to clipboard

Published 20 hours ago • verified publisher icon abetlen

Add the Phi 3 mini chat format

Open reddiamond1234 opened this issue 10 months ago • 3 comments

*my first PR :)

reddiamond1234 avatar Apr 26 '24 06:04 reddiamond1234

It's getting weird over on HF. MS has revised the Phi-3 chat format to completely ignore the system role, and are telling consumers to rewrite their prompt structures instead.

https://huggingface.co/microsoft/Phi-3-mini-4k-instruct/discussions/51

handshape avatar May 01 '24 18:05 handshape

@abetlen Is there any way I can help? Would be nice to get the phi 3 format in, now that the larger models have been released.

0cc4m avatar May 22 '24 05:05 0cc4m

Any success in merging this ?

RomainMendez avatar Jun 06 '24 20:06 RomainMendez