Typo.js icon indicating copy to clipboard operation
Typo.js copied to clipboard
verified publisher icon cfinke

Out of memory error with Portuguese dictionary and affix

Open dbolton opened this issue 14 years ago • 5 comments

When I try to use the Brazilian Portuguese dictionary and affix files I get an out of memory error (after a lengthy pause).

http://www.broffice.org/files/pt_BR-2011-05-27AOC.zip

I don't know if there is some unusual markup that is causing problems? C.f. https://github.com/cfinke/Typo.js/issues/7

dbolton avatar Aug 09 '11 19:08 dbolton

This is due to Brazilian Portuguese generating thousands of hyphenated permutations for nouns.

Since in our use case we are splitting hyphens and checking them as separate words, we are not saving every hyphenated instance of a word as a separate entry in dictionaryTable, we just split the permutation around the hyphens and add them as separate words.

Italian has similar problems but with ' instead of -. I will work on opening pull requests with our changes soon, but just thought I would put this here in case it saves someone time!

bananaoomarang avatar Jun 27 '16 15:06 bananaoomarang

Is there any update on this issue? Still can't load the Italian dictionary and affix file without running out of memory.

fil090302 avatar Nov 24 '17 13:11 fil090302

Sorry, I haven't had time to work on this.

cfinke avatar Dec 16 '17 03:12 cfinke

But will it happen? Thanks, i.

writemonkey avatar Dec 16 '17 10:12 writemonkey

Any plans for addressing this?

ghost avatar Aug 10 '22 23:08 ghost