spoken-to-signed-translation icon indicating copy to clipboard operation
spoken-to-signed-translation copied to clipboard

Published 20 hours ago • verified publisher icon sign-language-processing

Incorporate Gloss Sense Disambiguation

Open AmitMY opened this issue 2 years ago • 1 comments
trafficstars

Our current text-to-gloss translation can lead to ambiguity in the generated glosses. We propose enhancing our system by incorporating gloss sense disambiguation to better capture the intended meaning of the input text.

AmitMY avatar May 17 '23 07:05 AmitMY

To illustrate how big of a problem this is, here are four translations for `KLEIN'

https://signsuisse.sgb-fss.ch/fileadmin/signsuisse_ressources/videos/EB019CAA-D768-D07E-571E219A5F6AA5AB.mp4 https://signsuisse.sgb-fss.ch/fileadmin/signsuisse_ressources/videos/FC9A32C5-C1B1-9B67-BB8C75F7039B568D.mp4 https://signsuisse.sgb-fss.ch/fileadmin/signsuisse_ressources/videos/79B5C9E9-FFBD-7DD2-D579FB9D6E5BC384.mp4 https://signsuisse.sgb-fss.ch/fileadmin/signsuisse_ressources/videos/2171343E-AEF1-76DD-E213221C22CB0261.mp4

And it is unclear how to choose.

AmitMY avatar Aug 13 '23 20:08 AmitMY