SimCLR-tensorflow
SimCLR-tensorflow copied to clipboard
Constant loss
Hey @sthalles , Thanks for sharing the code. I was trying to run your code on my data but I am getting constant loss for every epoch. I tried varying temp, output_dim, epochs but nothing seems to be working out. Although I am training with a smaller batch size:32 still l was expecting loss will reduce slightly.
Also, For augmentation colour distortion s = 1 .0 images look like below.
I tried reducing s = 0.5 and lower still no change in the loss.
Have you come across similar kind of problem? If yes, can you suggest what might be the reason? Looking forward to hearing from you.
Thanks Aayush
@Aayushktyagi Thanks for question, I hope that they respond you. Can you tell me how you import your dataset ? I import my dataset with tf.data.Dataset.from_generator() but I find problems to train this code