evolutionary-model-merge icon indicating copy to clipboard operation
evolutionary-model-merge copied to clipboard

How long does it take to merge three 7B models?

Open tanganke opened this issue 10 months ago • 0 comments

How long does it take to merge three 7B models for different methods (PS, DFS, PS+DFS)?

  • Shisa Gamma 7B v1
  • WizardMath 7B v1.1
  • Abel 7B 002

And what are the system requirements to do the merge? Do I need to load 7B models simultaneously and merge them on GPUs or I can merge them lazily on disk like mergekit and load them to GPUs for evolutionary?

tanganke avatar Mar 28 '24 03:03 tanganke