model-merging topic

List model-merging repositories

LAMDA-ZhiJian

50
Stars
2
Forks
Watchers

ZhiJian: A Unifying and Rapidly Deployable Toolbox for Pre-trained Model Reuse

dataless-model-merging

81
Stars
5
Forks
Watchers

Code release for Dataless Knowledge Fusion by Merging Weights of Language Models (https://openreview.net/forum?id=FCnohuR6AnM)

mergekit

4.6k
Stars
406
Forks
26
Watchers

Tools for merging pretrained large language models.

AdaMerging

43
Stars
2
Forks
Watchers

AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.

Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities. arXiv:2408.07666.

della

23
Stars
1
Forks
Watchers

DELLA-Merging: Reducing Interference in Model Merging through Magnitude-Based Sampling

mergeui

21
Stars
2
Forks
Watchers

All-in-one UI for merged LLMs in Hugging Face

RepresentationSurgery

23
Stars
2
Forks
Watchers

Representation Surgery for Multi-Task Model Merging. ICML, 2024.

fusion_bench

43
Stars
7
Forks
Watchers

FusionBench: A Comprehensive Benchmark of Deep Model Fusion

tall_masks

31
Stars
0
Forks
Watchers

Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]