evolutionary-model-merge
evolutionary-model-merge copied to clipboard
SakanaAI
Official repository of Evolutionary Optimization of Model Merging Recipes
First of all, thanks for the great work. Any plans on releasing the merging code?
Releasing a github page meant to share a new merging method, only to provide no merging code whatsoever is a really shitty move. Its not so much the fact that...
I still feel hard to understand how to design the search space of DFS. Could you show me some explanations or demos? Code would be the best. Thanks!
Hi, thanks for this innovative work! Would you please make it clear to the community whether you will release your algorithms? Thanks for your precious time!
Thank you for providing innovative ideas. Is there any code available for merging models? I couldn't seem to find it in this GitHub repository. I am very interested in your...
How long does it take to merge three 7B models for different methods (PS, DFS, PS+DFS)? - Shisa Gamma 7B v1 - WizardMath 7B v1.1 - Abel 7B 002 And...
I've seen some compute hacks in make files to get around this issue, similar to specifying no_avx2 in text-generation-webui, but for compute compatibility for cuda... was hoping to run this...
Is this model the same structure as [LLaVA-1.6-Mistral-7B](https://huggingface.co/liuhaotian/llava-v1.6-mistral-7b) so I can use the same finetune code? But their config is totally different. Looking foe help, thanks a lot!
Hello, I tested the image in your paper Table 6 Example 3 with your model EvoVLM-7b, I got the following answer, not the same to your good results with (A)(B)(C)...
