git-re-basin icon indicating copy to clipboard operation
git-re-basin copied to clipboard

disjoint datasets merge model accuracy

Open qsunyuan opened this issue 2 years ago • 3 comments

Nice work.

The loss results for the test set are reported in Figure 5, but what about the accuracy.

In my experimental results, although the loss does drop, it seems that the accuracy is not very good (lower than the naive weight interp).

qsunyuan avatar Sep 19 '22 02:09 qsunyuan

Here's what I'm getting:

cifar100_resnet20_split_data_test_accuracy

samuela avatar Sep 22 '22 21:09 samuela

Here's what I'm getting:

cifar100_resnet20_split_data_test_accuracy

Hi! I'm trying to use git-rebasin in my work about disjoint datasets merge, while my result looks like this cifar10_resnet22_32_weight_matching_interp_accuracy_epoch This experiment is using ResNet20 with 32x width-multiplier on CIFAR10 dataset, splited into two CIFAR5 dataset. Can you tell me which model and dataset were you using? This is really important to me, thanks a lot!!

adampan0527 avatar Aug 02 '24 13:08 adampan0527

Here is the code used to generate the plot in the paper: https://github.com/samuela/git-re-basin/blob/main/src/cifar100_resnet20_split_data_plot.py

samuela avatar Aug 02 '24 15:08 samuela