will

I want to use this novel SSL method on some NLP missions, but I am not sure would it will work or not. Have anybody tried this ?

After read your paper and code, I have a question about the spell correction phase. Had you applied spell correction on pre-train dataset? Or you only applied this on fine-tune...