Can't Reproduce Rank Performance Results

[ChongzhouFang]

Hi,

I tried both MLP and CNN models, while only using the pre-trained CNN model (cnn_best_ascad_desync0_epochs75_classes256_batchsize200.h5) can achieve good rank performance as shown in the paper. Utilizing the pre-trained MLP model (mlp_best_ascad_desync0_node200_layernb6_epochs200_classes256_batchsize100.h5), or utilizing the MLP and CNN models trained from the training script isn't able to produce reasonable results. Could you please tell me what I might be missing here?

I have downloaded the ATM_AES_v1_fixed_key dataset and the corresponding pre-training models. I didn't modify the generating, training or testing scripts. The training parameter I am using is shown below:

{
"ascad_database" : "ATMEGA_AES_v1/ATM_AES_v1_fixed_key/ASCAD_data/ASCAD_databases/ASCAD_fixed.h5",
"training_model": "./trained_cnn.h5",
"network_type": "cnn",
"epochs": 100,
"batch_size": 100
}

and the testing parameters are shown below:

{
"ascad_database" : "ATMEGA_AES_v1/ATM_AES_v1_fixed_key/ASCAD_data/ASCAD_databases/ASCAD_fixed.h5",
"model_file": "./trained_cnn.h5",
"num_traces": 1000,
"save_file": "test_cnn.png"
}

Am I missing anything here?