axolotl icon indicating copy to clipboard operation
axolotl copied to clipboard

Published 20 hours ago • verified publisher icon OpenAccess-AI-Collective

Phi 3 support

Open fakerybakery opened this issue 1 year ago • 4 comments
trafficstars

⚠️ Please check that this feature request hasn't been suggested before.

  • [X] I searched previous Ideas in Discussions didn't find any similar feature requests.
  • [X] I searched previous Issues didn't find any similar feature requests.

🔖 Feature description

Would be nice to have support for Phi 3

✔️ Solution

Add support for Phi 3

❓ Alternatives

No response

📝 Additional Context

No response

Acknowledgements

  • [X] My issue title is concise, descriptive, and in title casing.
  • [X] I have searched the existing issues to make sure this feature has not been requested yet.
  • [X] I have provided enough information for the maintainers to understand and evaluate this request.

fakerybakery avatar Apr 23 '24 16:04 fakerybakery

Any progress on this?

monk1337 avatar Apr 29 '24 19:04 monk1337

is anyone working on this?

jinwonkim93 avatar Apr 30 '24 15:04 jinwonkim93

It already works fine.

  1. You currently need to install Transformers from git: pip install git+https://github.com/huggingface/transformers.git -U

  2. Make a copy of the examples/phi/phi-qlora.yml template.

  3. Update the base_model line to the Phi3 model you want.

  4. Add the line trust_remote_code: true.

richardburleigh avatar Apr 30 '24 17:04 richardburleigh

I have added one example for fft via this pr https://github.com/OpenAccess-AI-Collective/axolotl/pull/1580

monk1337 avatar Apr 30 '24 18:04 monk1337