TextModels.jl icon indicating copy to clipboard operation
TextModels.jl copied to clipboard

PoSTagger on other languages than English

Open tencnivel opened this issue 4 years ago • 0 comments

When trying to use PoSTagger on a text with a different language (but supported in the default Penn Treebank) than English, everything gets tagged as 'NNP'.

Here is how to reproduce the problem:

using TextModels
using TextAnalysis
using Languages

str = "André trouve cette maison très belle" 
sd = StringDocument(str)
pos = PoSTagger()
language!(sd,Languages.French())
pos(sd)

TextModels v0.1.0

tencnivel avatar Jan 13 '21 14:01 tencnivel