Open-Assistant
Open-Assistant copied to clipboard
Upload tool for XOR and compression of model deltas.
Added a Python script under scripts/xor-codec/xor_codec.py for encoding and decoding model weight deltas. (With optional gzip compression.)
Encode: xor_codec.py output_dir/ model_dir/ llama_dir/ --encode --compress
Decode: xor_codec.py output_dir/ delta_dir/ llama_dir/ --compress
:x: pre-commit failed.
Please run pre-commit run --all-files locally and commit the changes.
Find more information in the repository's CONTRIBUTING.md
@olliestanley could you push to this branch the latest version?
:x: pre-commit failed.
Please run pre-commit run --all-files locally and commit the changes.
Find more information in the repository's CONTRIBUTING.md
Oh no, this has suffered from the history messing up due to main -> main merge. I will close and start a new PR with Mick listed co-author