Caffe-DeepBinaryCode icon indicating copy to clipboard operation
Caffe-DeepBinaryCode copied to clipboard

Porting to Tensorflow / Keras. Help Needed

Open SarthakYadav opened this issue 8 years ago • 2 comments
trafficstars

Hello

I am trying to reproduce the results of this paper using Keras. I have implemented the loss function as seen in the paper, but the accuracy of the classifier never goes above 10%. To test the loss implementation, I am using a tiny CNN trained from scratch. The model structure is as seen in the image attached. I have also tried building on top of a pre-trained VGG16, but the results are the same. model As seen from the name, the second last layer called "latent_48bit" is the latent layer with the sigmoid activation. The final layer is the softmax classifier.

Is the model architecture correct?

Also, can you help me with the loss function? I believe that's where I am going wrong.

SarthakYadav avatar Jul 20 '17 06:07 SarthakYadav

How about removing your loss function, and training with only the softmax loss function at first?

2017-07-19 23:25 GMT-07:00 Sarthak Yadav [email protected]:

Hello

I am trying to reproduce the results of this paper using Keras. I have implemented the loss function as seen in the paper, but the accuracy of the classifier never goes above 10%. To test the loss implementation, I am using a tiny CNN trained from scratch. The model structure is as seen in the image attached. I have also tried building on top of a pre-trained VGG16, but the results are the same. [image: model] https://user-images.githubusercontent.com/8536280/28368776-39529454-6cb3-11e7-9c5a-52c4c3f3b9aa.png As seen from the name, the second last layer called "latent_48bit" is the latent layer with the sigmoid activation. The final layer is the softmax classifier.

Is the model architecture correct?

Also, can you help me with the loss function? I believe that's where I am going wrong.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/kevinlin311tw/Caffe-DeepBinaryCode/issues/18, or mute the thread https://github.com/notifications/unsubscribe-auth/AJgtML6hLFWAAmX2RjZlEgriFjXQpIZzks5sPvLNgaJpZM4Odp0F .

--

Best regards,

林可昀

Kevin Lin

kevinlin311tw avatar Jul 25 '17 19:07 kevinlin311tw

Trains fine with Softmax!

SarthakYadav avatar Jul 26 '17 05:07 SarthakYadav