spoken-to-signed-translation
spoken-to-signed-translation copied to clipboard
sign-language-processing
English to ASL
Hello, This repository does not have English to ASL. But https://sign.mt has english to ASL working. Can you please guide how to add English to ASL translation?
Hello, This repository does not have English to ASL. But sign.mt has english to ASL working. Can you please guide how to add English to ASL translation?
I have the same doubt
This repository allows loading any lexicon. For example, we load the suisse lexicon, but any lexicon can be added. sign.mt is an independent website, that uses this project, but with other lexicons. Adding ASL to this repository will be as simple as the suisse lexicon, all there needs to be is:
- directory with poses
- index file pointing at the poses
see our example lexicon.
sign.mt is an independent website, that uses this project, but with other lexicons.
Can you please point me where in sign/translate you used lexicons or the models you trained from it?
All I found was here an I am not sure how to use those in python even if I re-trained using this
In sign/translate, the backend for the spoken-text-to-pose is closed source for multiple reasons.
Ideally, everything will work client side only, but this is not yet the case.
In
sign/translate, the backend for thespoken-text-to-poseis closed source for multiple reasons.
Is it because of licensing ?
Thankyou for clarifying. One thing i want to know is that whether this repository be useful for text to gloss if I want to convert english text to ASL gloss and then run GLoss lookup for custom ASL glosses?
If yes then how? as currently it looks like it supports other language but not english. If No, Then how can i create glosses from text for english for ASL?
Using the spacylemma module or simple module, you can lemmatize English text into pseudo-glosses.
If you'd like the rules module to work for ASL, you would have to implement the rules of the grammar.
@AmitMY Thankyou for clarifying. I understand the pseudo-glosses part. But can you please specify resources/logic for english ASL glosses for grammar rule? is it implemented somewhere or if not then any description about the rules which can help in implementation?
In my opinion, you should start from the spacylemma implementation, and only when everything works for you consider adding grammar manipulations (rules)
There are many resources on grammar
- https://en.wikipedia.org/wiki/American_Sign_Language_grammar
- https://www.lifeprint.com/asl101/pages-layout/grammar.htm
- and books