EC-BERT icon indicating copy to clipboard operation
EC-BERT copied to clipboard

在SemEval2010Task8数据上没有达到你的效果?

Open cjwen15 opened this issue 3 years ago • 5 comments

Micro-averaged result (excluding Other): P = 71/1953 = 3.64% R = 71/2263 = 3.14% F1 = 3.37%

MACRO-averaged result (excluding Other): P = 6.65% R = 3.25% F1 = 3.49%

<<< The official score is (9+1)-way evaluation with directionality taken into account: macro-averaged F1 = 3.49% >>>

不知是否模型的问题?

cjwen15 avatar Nov 24 '20 08:11 cjwen15

Micro-averaged result (excluding Other): P = 71/1953 = 3.64% R = 71/2263 = 3.14% F1 = 3.37%

MACRO-averaged result (excluding Other): P = 6.65% R = 3.25% F1 = 3.49%

<<< The official score is (9+1)-way evaluation with directionality taken into account: macro-averaged F1 = 3.49% >>>

不知是否模型的问题?

你好,不知道你后面有没有继续进行尝试,是否达到89%,你是自己重新训练还是直接使用作者提供的模型进行测试呢

wenyu332 avatar Dec 22 '20 07:12 wenyu332

Micro-averaged result (excluding Other): P = 71/1953 = 3.64% R = 71/2263 = 3.14% F1 = 3.37% MACRO-averaged result (excluding Other): P = 6.65% R = 3.25% F1 = 3.49% <<< The official score is (9+1)-way evaluation with directionality taken into account: macro-averaged F1 = 3.49% >>> 不知是否模型的问题?

你好,不知道你后面有没有继续进行尝试,是否达到89%,你是自己重新训练还是直接使用作者提供的模型进行测试呢

我是直接使用作者的模型进行测试的,无其他修改

cjwen15 avatar Dec 22 '20 07:12 cjwen15

Micro-averaged result (excluding Other): P = 71/1953 = 3.64% R = 71/2263 = 3.14% F1 = 3.37% MACRO-averaged result (excluding Other): P = 6.65% R = 3.25% F1 = 3.49% <<< The official score is (9+1)-way evaluation with directionality taken into account: macro-averaged F1 = 3.49% >>> 不知是否模型的问题?

你好,不知道你后面有没有继续进行尝试,是否达到89%,你是自己重新训练还是直接使用作者提供的模型进行测试呢

我是直接使用作者的模型进行测试的,无其他修改

好的,谢谢你 那你最后结果有多少呢

wenyu332 avatar Dec 22 '20 07:12 wenyu332

Micro-averaged result (excluding Other): P = 71/1953 = 3.64% R = 71/2263 = 3.14% F1 = 3.37%

MACRO-averaged result (excluding Other): P = 6.65% R = 3.25% F1 = 3.49%

<<< The official score is (9+1)-way evaluation with directionality taken into account: macro-averaged F1 = 3.49% >>>

不知是否模型的问题?

模型没有问题,另一个我最近的工作:Mul-BERT,你可以看看,在SemEval 2010 Task 8 上最高达到90.72%(Macro-F1), 模型很简单

DongPoLI avatar Jan 14 '21 07:01 DongPoLI

您好,请问哪里可以看到论文呢

LemonQC avatar Mar 26 '21 08:03 LemonQC