mergekit
mergekit copied to clipboard
Merge arbitrary pytorch models
Done in a dumb way for now. Going to revisit this and make it more general at some point in the future.
To try:
merge_method: dare_ties
base_model: model_base.safetensors
models:
- model: model_a.safetensors
parameters:
density: 0.6
weight: 0.7
- model: model_b.safetensors
parameters:
density: 0.4
weight: 0.3
parameters:
normalize: true
int8_mask: true
mergekit-pytorch ./config.yaml ./merged_model_folder [--tensor-intersection] [--tensor-union] [--cuda]