model-merging topic
LAMDA-ZhiJian
ZhiJian: A Unifying and Rapidly Deployable Toolbox for Pre-trained Model Reuse
dataless-model-merging
Code release for Dataless Knowledge Fusion by Merging Weights of Language Models (https://openreview.net/forum?id=FCnohuR6AnM)
mergekit
Tools for merging pretrained large language models.
AdaMerging
AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.
Awesome-Model-Merging-Methods-Theories-Applications
Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities. arXiv:2408.07666.
della
DELLA-Merging: Reducing Interference in Model Merging through Magnitude-Based Sampling
mergeui
All-in-one UI for merged LLMs in Hugging Face
RepresentationSurgery
Representation Surgery for Multi-Task Model Merging. ICML, 2024.
fusion_bench
FusionBench: A Comprehensive Benchmark of Deep Model Fusion
tall_masks
Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]