SimCLR-tensorflow icon indicating copy to clipboard operation
SimCLR-tensorflow copied to clipboard

Constant loss

Open Aayushktyagi opened this issue 4 years ago • 1 comments

Hey @sthalles , Thanks for sharing the code. I was trying to run your code on my data but I am getting constant loss for every epoch. I tried varying temp, output_dim, epochs but nothing seems to be working out. Although I am training with a smaller batch size:32 still l was expecting loss will reduce slightly.

Screenshot from 2020-05-22 18-35-35

Also, For augmentation colour distortion s = 1 .0 images look like below. Screenshot from 2020-05-22 17-23-31 I tried reducing s = 0.5 and lower still no change in the loss.

Have you come across similar kind of problem? If yes, can you suggest what might be the reason? Looking forward to hearing from you.

Thanks Aayush

Aayushktyagi avatar May 22 '20 13:05 Aayushktyagi

@Aayushktyagi Thanks for question, I hope that they respond you. Can you tell me how you import your dataset ? I import my dataset with tf.data.Dataset.from_generator() but I find problems to train this code

aynesss avatar Sep 11 '20 11:09 aynesss