OKR
OKR copied to clipboard
Berkeley dependency parser fails on punctuation
Turns out that that Berkeley fails on sentences containing 3 subsequent '?'!' marks.
@kleinay overcame this problem by wrapping the single-sentence parsing stage with "try-except" block, logging and then ignoring sentences that it couldn't parse.
@kleinay, can you please post a problematic example sentence?
Thanks!
for example (tweet 259284336363319296 from boy_scouts scenerio): "Over 1,000 Files Of Sex Abuse And The Boy Scouts Tried To Cover It Up?!?"