Open-Assistant
Open-Assistant copied to clipboard
Add xor_codec script (thanks Mick)
Original PR history was broken.
Encode: xor_codec.py output_dir/ model_dir/ llama_dir/ --encode Decode: xor_codec.py output_dir/ delta_dir/ llama_dir/
Co-authored-by: umbra-scientia [email protected]
Lets skip this PR and use this one instead: https://github.com/LAION-AI/Open-Assistant/pull/2829
The simple XOR format is too finicky and users are having problems with minor differences in HuggingFace and PyTorch versions. The new script is designed to be immune to or graceful with those details.