anago icon indicating copy to clipboard operation
anago copied to clipboard

results is not in line with yours

Open sue2xlh opened this issue 7 years ago • 8 comments

hi, i run the program according to the procedure, train, evaluate, tag... but the result is not in line with yours

evaluate

sue2xlh avatar Sep 21 '17 10:09 sue2xlh

and i run the same sent "President Obama is speaking at the White House.", the results are different at each time, i couldn't know this is normal condition results

sue2xlh avatar Sep 22 '17 02:09 sue2xlh

and why the eval results are different at each time

result2

sue2xlh avatar Sep 22 '17 05:09 sue2xlh

and i also want to know if i use B I E O tag , the program is normal

sue2xlh avatar Sep 22 '17 09:09 sue2xlh

Hi, @Sue52nlp

You can use BIEO tags. But you need to rewrite evaluation code, especially get_entities function because It is assumed that the function is used for BIO tag.

Hironsan avatar Sep 22 '17 10:09 Hironsan

hi,Hironsan Thank you for your reply, can you tell me why the eval results are different at each time

sue2xlh avatar Sep 25 '17 01:09 sue2xlh

How to run an example as mentioned? I do not know anything about it.

lengocthuan avatar Jun 16 '18 20:06 lengocthuan

Please help me,

lengocthuan avatar Jun 16 '18 20:06 lengocthuan

I have a similar issue. I simply downloaded the files and did the proper setup to run on GPU. Didn't change any variables.

While running the training, -f1 starts at 86, and goes up to 91.88 after a few rounds. However, when evaluating I get the following results:

evaluator = anago.Evaluator(model_config, weights, save_path=SAVE_ROOT, preprocessor=p) evaluator.eval(x_test, y_test)

  • f1: 3.09

tagger = anago.Tagger(model_config, weights, save_path=SAVE_ROOT, preprocessor=p) sent = 'President Obama is speaking at the White House.' tagger.tag(sent) [('President', 'O'), ('Obama', 'O'), ('is', 'O'), ('speaking', 'O'), ('at', 'O'), ('the', 'O'), ('White', 'O'), ('House.', 'O')]

Any ideas? Maybe I have an incomplete corpus or other errors, but I don't understand the difference in F score while training and then when evaluating.

mvallet91 avatar Aug 01 '18 10:08 mvallet91