CipherGAN icon indicating copy to clipboard operation
CipherGAN copied to clipboard

Cannot output accuracy

Open kanwangshijie-sudo opened this issue 5 years ago • 9 comments

Hello,I encountered a problem.Following the operation of the README, the training was successful. However, the output is xy_mse, and I want to output the accuracy.Therefore, the xy_mse of the train.py file is changed to acc, But the accuracy cannot be output.

I get the following error: ValueError:MetricSpec without specified prediction_key requires predictions tensor or single element dict, got {'X': <tf.Tensor 'cycle_gan/transforms/G/Reshape_1:0' shape=(64, 100, 202) dtype=float32>, 'Y': <tf.Tensor 'cycle_gan/transforms/F/Reshape_1:0' shape=(64, 100, 202) dtype=float32>}. I look forward to your answer,best wishes,thank you.

kanwangshijie-sudo avatar Apr 17 '20 15:04 kanwangshijie-sudo

Which version of TF are you running?

aidangomez avatar Apr 17 '20 15:04 aidangomez

Which version of TF are you running?

TF1.4

kanwangshijie-sudo avatar Apr 17 '20 15:04 kanwangshijie-sudo

Which version of TF are you running?

I want to ask how you output the accuracy rate at that time. I changed the xy_mse of the train.py file to acc

kanwangshijie-sudo avatar Apr 17 '20 15:04 kanwangshijie-sudo

Have you tried looking at the tensorboard for your run? I think we may log more metrics in the tensorboard than what we print to terminal.

aidangomez avatar Apr 17 '20 15:04 aidangomez

Have you tried looking at the tensorboard for your run? I think we may log more metrics in the tensorboard than what we print to terminal.

Hello, I read the tensorboard, there are X_groundtruth_acc and Y_groundtruth_acc, but there is no final result acc

kanwangshijie-sudo avatar Apr 17 '20 16:04 kanwangshijie-sudo

I think those accuracies are the final accuracies they report whether F and G have found the right encode() and decode() maps

aidangomez avatar Apr 17 '20 18:04 aidangomez

I think those accuracies are the final accuracies they report whether F and G have found the right encode() and decode() maps

OK, thank you, but my X_groundtruth_acc and Y_groundtruth_acc are only about 60%, and my data set is vigenere345_brown200,What is going on, the accuracy of your thesis is 75.7%.

kanwangshijie-sudo avatar Apr 18 '20 01:04 kanwangshijie-sudo

I would recommend double checking that all the hyperparameters are set as described in paper + appendix and ensure you're using the right timing signal etc.

aidangomez avatar Jul 07 '20 16:07 aidangomez

Which version of TF are you running?

I want to ask how you output the accuracy rate at that time. I changed the xy_mse of the train.py file to acc

How did you output accuracy?

Mariam-73 avatar Jul 13 '20 16:07 Mariam-73