german-gpt2 icon indicating copy to clipboard operation
german-gpt2 copied to clipboard

Evaluation metric for generated text

Open julfr opened this issue 2 years ago • 0 comments

Hello, thank you for your great project! I tried to fine-tune the model with my german text and noticed, that generated sentences are mostly copied from my training dataset. Could you please advice which metric to use to evaluate the generated sentences? Is there a possibility to check, how much of the generated sentence was "copied" from dataset? Thanks in advance!

julfr avatar Sep 26 '22 13:09 julfr