kenlm icon indicating copy to clipboard operation
kenlm copied to clipboard

ERROR: 1-gram discount out of range for adjusted count 2

Open Sundy1219 opened this issue 7 years ago • 2 comments

Hi,I have a Chinese text,which have 6300440 lines,about 315MB it likes this: 2018-07-13 10-33-21

I use the command lmplz -o 5 --prune 1 2 2 3 4 lm.arpa

The error ocurrs: 2018-07-13 10-32-25

What is wrong with it ? How to resolve it ? Thanks @kpu

Sundy1219 avatar Jul 13 '18 02:07 Sundy1219

Does adding --discount_fallback fix it?

kpu avatar Jul 29 '18 08:07 kpu

it did for me, thank you.

Ltorrado avatar Nov 29 '18 12:11 Ltorrado