ipatok
ipatok copied to clipboard
pavelsof
IPA tokeniser
Results
2
ipatok issues
Sort by
recently updated
recently updated
newest added
Is there a way for the tokeniser to keep the stress symbols in the IPA transcription?
I didn't check your data carefull, but this is what we use for lingpy's "ipa2tokens" function: * https://github.com/lingpy/lingpy/blob/master/lingpy/tests/test_data/test_tokenization.tsv You might want to check against those, as lingpy yields 100% tokenizations...
