NLP-Project icon indicating copy to clipboard operation
NLP-Project copied to clipboard

transformer训练准确度低

Open Augus753 opened this issue 5 years ago • 3 comments

你好。很感谢您提供的代码教程。目前发现transformer训练准确度低。只有不到60%,大大低于TextCNN的85%,请问您当时测试也是如此吗?若是提高,可以给点建议吗?谢谢 text_classifier/models/transformer.py

Augus753 avatar Dec 03 '19 08:12 Augus753

transformer训练过程最后维度归一化时矩阵相乘维度出错,你改了什么地方吗

VerusHao avatar May 09 '20 09:05 VerusHao

请问transformer在进行中文二分类时运行test.py出现InvalidArgumentError (see above for traceback): Inputs to operation transformer/transformer-1/multi_head_atten/Select of type Select must have the same size and shape. Input 0: [8,150,150] != input 1: [240,150,150]错误是什么原因了谢谢

wuxi-xc avatar Oct 19 '22 07:10 wuxi-xc

您好,请问您在运行test.py时会出现错误吗,求解急

wuxi-xc avatar Oct 19 '22 07:10 wuxi-xc