transformer-srl icon indicating copy to clipboard operation
transformer-srl copied to clipboard

Training_Dependency_Based_Model

Open LeonHammerla opened this issue 2 years ago • 1 comments

The config jsonnet for the bert-base model (bert_base_dep.jsonnet) has the following lines:

"model": { "type": "transformer_srl_span", "embedding_dropout": 0.1, "bert_model": "bert-base-cased", },

which should be transformer_srl_dependency??? When changing to dependency running and training of the model results in an ERROR

When trying to train a model based on the bert_tiny_dep.jsonnet (which has the correct model-type) training also results in an ERROR, stating:

TypeError: forward() got an unexpected keyword argument 'sentence_end'

LeonHammerla avatar May 04 '22 12:05 LeonHammerla

possible fix: add **kwargs to forward method in model.py of transformer_srl_dependency model?

LeonHammerla avatar May 04 '22 13:05 LeonHammerla