Albert mark

Results 2 issues of Albert mark

loss = cosine_similarity_loss(outputs_net, output_target) + \ supervised_weight * supervised_loss(outputs_net, targets) Could you share this supervised weight setting?THANKS

Hello, thank you very much for your work. I found that the code is incomplete and many things are missing. Could you please upload a complete code? Thank you very...