fine-tune bert_12_768_12

[Shafi2016]

If we fine-tune bert_12_768_12 with mxnet/gluon. Can we then fine-tune BERT with Bert embedding of (https://github.com/imgarylai/bert-embedding)?. Can we integrate fine-BERT from huggingface wtih gulon.?

[sxjscience]

Would you give more information about fine-BERT?

[Shafi2016]

I want to fine-tune on my own data.

I fine-tune with BERT with a hugging face and the results sufficiently improved. I want to do the same to use it with bert embedding. I am using bert emedding to find the similar words. I have not yet attempted but I think it should not be a problem as Bert embedding of (https://github.com/imgarylai/bert-embedding) is build on gluon.