Open-Assistant icon indicating copy to clipboard operation
Open-Assistant copied to clipboard

Upload tool for XOR and compression of model deltas.

Open umbra-scientia opened this issue 2 years ago • 1 comments

Added a Python script under scripts/xor-codec/xor_codec.py for encoding and decoding model weight deltas. (With optional gzip compression.)

Encode: xor_codec.py output_dir/ model_dir/ llama_dir/ --encode --compress

Decode: xor_codec.py output_dir/ delta_dir/ llama_dir/ --compress

umbra-scientia avatar Apr 20 '23 16:04 umbra-scientia

:x: pre-commit failed. Please run pre-commit run --all-files locally and commit the changes. Find more information in the repository's CONTRIBUTING.md

github-actions[bot] avatar Apr 20 '23 16:04 github-actions[bot]

@olliestanley could you push to this branch the latest version?

andreaskoepf avatar Apr 21 '23 22:04 andreaskoepf

:x: pre-commit failed. Please run pre-commit run --all-files locally and commit the changes. Find more information in the repository's CONTRIBUTING.md

github-actions[bot] avatar Apr 21 '23 22:04 github-actions[bot]

Oh no, this has suffered from the history messing up due to main -> main merge. I will close and start a new PR with Mick listed co-author

olliestanley avatar Apr 21 '23 22:04 olliestanley