DATM icon indicating copy to clipboard operation
DATM copied to clipboard

Need to Modify Config Files to Reproduce Results from the Paper?

Open MyFirstKindom opened this issue 1 year ago • 3 comments

Hello,

I am attempting to reproduce the results presented in the paper [Title of the Paper]. Could you please clarify whether it is necessary to modify the config files provided in the repository? If so, could you provide guidance on which specific parameters or sections need to be adjusted to achieve the same experimental setup as described in the paper?

Thank you for your assistance.

MyFirstKindom avatar Jul 19 '24 03:07 MyFirstKindom

df4ca89ea184035472f6af947ffdf0b2 This is the result of my run, and it seems to be slightly different from the one in the paper.

MyFirstKindom avatar Jul 19 '24 03:07 MyFirstKindom

This is the instruction I use for evaluation: python evaluation.py --lr_dir=../logged_files/CIFAR10/10/ConvNet/my_run_name/Normal/lr_best.pt --data_dir=../logged_files/CIFAR10/10/ConvNet/my_run_name/Normal/images_best.pt --label_dir=../logged_files/CIFAR10/10/ConvNet/my_run_name/Normal/labels_best.pt --zca

MyFirstKindom avatar Jul 19 '24 03:07 MyFirstKindom

Sorry for the late response. Maybe it's because you didn't change the parameters used in training the expert models. (As we reported in the paper, we generate expert trajectories in the same way as FTD without modifying the involved hyperparameters.) So please refer to the FTD paper to get the hyper-parameters used in buffer.py

GzyAftermath avatar Jul 29 '24 14:07 GzyAftermath