evolutionary-model-merge
evolutionary-model-merge copied to clipboard
How long does it take to merge three 7B models?
How long does it take to merge three 7B models for different methods (PS, DFS, PS+DFS)?
- Shisa Gamma 7B v1
- WizardMath 7B v1.1
- Abel 7B 002
And what are the system requirements to do the merge? Do I need to load 7B models simultaneously and merge them on GPUs or I can merge them lazily on disk like mergekit and load them to GPUs for evolutionary?