yalign
yalign copied to clipboard
machinalis
please provide a phrase table demo
Hi, I found that this align tool is very useful. And I wanna to train a model of my own, but I do not have any phrase table could you provide a phrase table demo? many thanks!
I turned to an other align program. Based on gale church align and the bleu score of machine translation
On Oct 24, 2018, at 12:00, Erik Chan [email protected] wrote:
Did you have any luck?
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub, or mute the thread.
Was it bleualign? Or something else? It would be great if you can share what you used.
Yes bleualign. I made a task queue to auto align the parellel web pages downloaded by scrapy. The machine translation is from google .
On Oct 24, 2018, at 12:54, Erik Chan [email protected] wrote:
Was it bleualign? Or something else? It would be great if you can share what you used.
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub, or mute the thread.
Thanks! I was initially also using bleualign, but had too many documents to align and using google translate is too expensive for my project.
You can use the free google translation , slow down the request and increase the number of concurrent the yalign need language models. I think bleualign is more useful for short pages alignment
On Oct 24, 2018, at 13:27, Erik Chan [email protected] wrote:
Thanks! I was initially also using bleualign, but had too many documents to align and using google translate is too expensive for my project.
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub, or mute the thread.
Same problem here. But I saw someone already has their language pair for alignment. I also found a parper that talked about improving the performance of Yalign. https://arxiv.org/abs/1512.01641 didn't mentioned the creation of dictionary(phrase table), but might be helpful.
