membership-inference icon indicating copy to clipboard operation
membership-inference copied to clipboard

How to optimize the parameter

Open knightcao opened this issue 6 years ago • 5 comments

Hello, Song. I try your code via UCI adult's salary data set and cifar10. I get a result similar with yours for adult's salary data set, however for cifar10, i get the a very low accuracy. I guess maybe some parameter is need optimized, such as batch_size or epochs.
So, I wonder if you willing to publish your parameters ? And another question is that for images, I should replace the Target's and Shadow's models from NN to CNN or other? Thank you, I really appreciate your work.

knightcao avatar Nov 04 '18 21:11 knightcao

Hi, On cifar10 you will need a bigger neural nets than the one in the demo code. CNN is a good idea :)

csong27 avatar Nov 06 '18 16:11 csong27

Thank you, happy voteday.

knightcao avatar Nov 06 '18 18:11 knightcao

I found under fitting will take place with default parameter in most dataset. I dont know whether properly or not? Thank you.

knightcao avatar Nov 09 '18 19:11 knightcao

You will have to fit each dataset with its own best hyper-parameters.

csong27 avatar Nov 10 '18 21:11 csong27

Thank you, have a good weekend.

knightcao avatar Nov 10 '18 23:11 knightcao