lttoolbox
lttoolbox copied to clipboard
apertium
Finite state compiler, processor and helper tools used by apertium
Hello! There are so many non-whitespace symbols that are not recognized by Apertium's tagger and not marked in any way. For example, apertium-tat does not recognize the following symbols: _...
A tool should be included in lttoolbox which calculates a BPE vocabulary as defined in this paper: https://arxiv.org/pdf/1508.07909.pdf The idea is to use BPE to weight our morphological transducers.
I am trying to add weights to the morphological analyser. So while I was checking last year's project (http://wiki.apertium.org/wiki/User:Techievena/GSoC_2018_Work_Product_Submission) I noticed that the output of the analyser isn't correct (according...
Probably, incorrect output for: ``` *+* => ^*+*/*+*$ * => ^*/*$ $ => ^$/$$ / => ^///$ ``` Tested on apertium-tat.
``` fran@matxine:~/source/apertium/staging/apertium-mlt-heb$ make apertium-validate-dictionary apertium-mlt-heb.mlt-heb.dix lt-comp rl apertium-mlt-heb.mlt-heb.dix heb-mlt.autobil.bin lt-trim .deps/heb.automorf.bin heb-mlt.autobil.bin heb-mlt.automorf.bin Error: empty set of final states Makefile:764: recipe for target 'heb-mlt.automorf.bin' failed make: *** [heb-mlt.automorf.bin] Error 1...
It seem a bit of overkill to have two separate file formats for this stuff.
Hello, We have defined two post-generation files to be able to apply the 'l apostrophe in Asturian. We have defined two post-generators with a rule for that particular case in...
