PersonalizedFL icon indicating copy to clipboard operation
PersonalizedFL copied to clipboard

MetaFed hyperparameters?

Open Buhua-Liu opened this issue 2 years ago • 1 comments

Hi,

Thanks for sharing the code. The hyperparameters for fedmeta seems missing in the run.sh, so I just run python main.py --alg metafed --dataset medmnist --iters 300 --wk_iters 1 --non_iid_alpha 0.1 --model_momentum 0.3, and I got an average accuracy 54.53. But the accuracy in the benchmark is 83.87, and which is 90.81 in Table 3 of your paper.

image

Thanks for your attention!

Buhua-Liu avatar Aug 05 '22 15:08 Buhua-Liu

Thank you for your question. We have revised run.sh. Please refer to the latest version. Please utilize the same splits of data and the same environment for re-implementations. This open-source library did not exist when we performed experiments on MetaFed. Therefore, there might be some differences in results due to different environments, data splits, and some other factors.

lw0517 avatar Aug 06 '22 05:08 lw0517