Hong Lu comments

Results 5 comments of


                                            Hong Lu

no lr_layer_decay_rate for embedding

Does this mean the learning rate decay was only applied to the 24 transformer layers? Not to the embedding layers or the dense layers for start and end logits? I'm...

[ASK] [tc_multi_languages_transformers.ipynb] temporary data directory and cache directory are not deleted after the notebook run

I thought #487 is about fixing the temp directory usage in the tests. This is a notebook and it's already using a TemporaryDirectory for both data loading and SequenceClassifier initialization....

[ASK] [tc_multi_languages_transformers.ipynb] temporary data directory and cache directory are not deleted after the notebook run

@miguelgfierro This is not related to the tests. This is just about running the notebook locally. I think Daisy meant the TemporaryDirectory needs to be explicitly deleted at the end...

[ASK] [tc_multi_languages_transformers.ipynb] temporary data directory and cache directory are not deleted after the notebook run

@kehuangms Did you verify the cleanup happened as expected? I think the reason @daden-ms created the issues is the cleanup didn't happen.

[ASK] Adding custom entity labels to BERT NER

@atakanokan Yes. It's possible to have custom entity labels. It's like a muti-class classification problem, the model can handle any labels exist in the training data. If you have your...