Rouge might not be correct

[elronbandel]

Rouge in the old unitxt had some preprocessing that is not included here. (something to do with separation of sentences) this might affect the results. @gitMichal