transformers icon indicating copy to clipboard operation
transformers copied to clipboard

Add support for GGUF Phi-3

Open dabs9 opened this issue 1 year ago • 6 comments

Model description

Model is Phi-3 saved as a GGUF.

Open source status

  • [X] The model implementation is available
  • [X] The model weights are available

Provide useful links for the implementation

It would be the analog of this recent PR but for Phi 3: https://github.com/huggingface/transformers/commit/e4628434d854ddfb5c002a6cc00b4eb4f22b7df2#diff-55e3debce4586d986257d1b1acb48c8708504f4b3b63e413e89f27ac2cc738b3

dabs9 avatar Jul 07 '24 07:07 dabs9