maxtext icon indicating copy to clipboard operation
maxtext copied to clipboard

Add a conversion script from maxtext gemma-2 and gemma-3 to huggingface format

Open hxssgaa opened this issue 1 year ago • 2 comments

Description

Create a conversion script from maxtext gemma-2 including gemma-2 2b/9b/27b to huggingface format.

Tests

I have converted the maxtext version of gemma-2-9b-it and gemma-2-27b-it into huggingface format and examined converted parameter weights and it matches with official huggingface gemma-2 weight.

Checklist

Before submitting this PR, please make sure (put X in square brackets):

  • [X] I have performed a self-review of my code.
  • [X] I have necessary comments in my code, particularly in hard-to-understand areas.
  • [X] I have run end-to-end tests tests and provided workload links above if applicable.
  • [X] I have made or will make corresponding changes to the doc if needed.

hxssgaa avatar Mar 01 '25 15:03 hxssgaa

Thanks for your pull request! It looks like this may be your first contribution to a Google open source project. Before we can look at your pull request, you'll need to sign a Contributor License Agreement (CLA).

View this failed invocation of the CLA check for more information.

For the most up to date status, view the checks section at the bottom of the pull request.

google-cla[bot] avatar Mar 01 '25 15:03 google-cla[bot]

I have added conversion script for gemma-3 and examined converted parameter weights and it matches with official huggingface gemma-3 weight.

hxssgaa avatar Mar 16 '25 16:03 hxssgaa