mergekit icon indicating copy to clipboard operation
mergekit copied to clipboard

Merge arbitrary pytorch models

Open cg123 opened this issue 8 months ago • 0 comments

Done in a dumb way for now. Going to revisit this and make it more general at some point in the future.

To try:

merge_method: dare_ties
base_model: model_base.safetensors
models:
  - model: model_a.safetensors
    parameters:
      density: 0.6
      weight: 0.7
  - model: model_b.safetensors
    parameters:
      density: 0.4
      weight: 0.3
parameters:
  normalize: true
  int8_mask: true

mergekit-pytorch ./config.yaml ./merged_model_folder [--tensor-intersection] [--tensor-union] [--cuda]

cg123 avatar May 31 '24 05:05 cg123