character-bert
character-bert copied to clipboard
MLM head pre-trained weights of character-bert
Hi,
I just found that the input embeddings of character-bert encoder are not tied with the output MLM weights. I would appreciate it if you could also release the pre-trained general-character-bert models with the MLM head pre-trained weights, as our group would like to explore further pre-training using character-bert.
Many Thanks