InvokeAI icon indicating copy to clipboard operation
InvokeAI copied to clipboard

[enhancement]: localize prompts

Open ParisNeo opened this issue 2 years ago • 3 comments

Is there an existing issue for this?

  • [X] I have searched the existing issues

Contact Details

No response

What should this feature add?

Prompts are mostly written in english. Since the UI supports multiple languages, Why not add the possibility to write the prompt in a different language.

I can develop a python script that uses the mbart-large-50-many-to-many-mmt model from facebook which is available on hugging face servers to translate the prompt from the language to English. Thus people can write their prompts in their favorite language and still can have answers.

This should just add a translation step before starting the diffusion execution.

Alternatives

No response

Aditional Content

No response

ParisNeo avatar Feb 09 '23 21:02 ParisNeo

Although it is a nice idea, it must be optional, as SD understands a little bit of other languages, and mixing languages in the prompt results in interesting images.

女性 for example will return a japanese woman without translation.

hugodopradofernandes avatar Feb 12 '23 06:02 hugodopradofernandes

Totally agree. I propose to add it in the options just like the super-resolution or face restauration

ParisNeo avatar Feb 12 '23 10:02 ParisNeo

I have already coded this in my personal UI for stable diffusion and I think this should be done in a more global tool like invoke ai

ParisNeo avatar Feb 12 '23 10:02 ParisNeo

There has been no activity in this issue for 14 days. If this issue is still being experienced, please reply with an updated confirmation that the issue is still being experienced with the latest release.

github-actions[bot] avatar Feb 27 '23 06:02 github-actions[bot]

Hi,

I want to grub this issue and add the translation tool to it if possible. But I am waiting for the team to move to the new nodes based UI before starting my development.

ParisNeo avatar Feb 28 '23 19:02 ParisNeo

There has been no activity in this issue for 14 days. If this issue is still being experienced, please reply with an updated confirmation that the issue is still being experienced with the latest release.

github-actions[bot] avatar Mar 16 '23 06:03 github-actions[bot]

I still would like to add the language localization. Still wait for moving to the new nodes based UI before starting my development.

ParisNeo avatar Mar 16 '23 10:03 ParisNeo

There has been no activity in this issue for 14 days. If this issue is still being experienced, please reply with an updated confirmation that the issue is still being experienced with the latest release.

github-actions[bot] avatar Apr 01 '23 06:04 github-actions[bot]

I have already created an extension called prompt_translator for AUTOMATIC1111's sd-webui. I can bring the same idea to InvokeAI

ParisNeo avatar Apr 01 '23 09:04 ParisNeo

Hi @ParisNeo if you are still interested, the nodes backend is fully up and ready for contributions!

Millu avatar Nov 09 '23 06:11 Millu

Hello there and thank you for answering. It's been a long time since i've posted this. I have been developping my own ai tool the last months and it takes up all my free time as I am the lead dev. I'll try to checkout this and maybe integrate my artbot in there instead. Artbot is a prompt generation llm that can build very good prompts from text from any language. So basically the user writes few words and the Ai does the rest. It is one of more than 300 tools in my lord of large language models tool. If you are interested to check it out, it is on my github. It has a server in the backend, so with some simple python code you can integrate it anywhere. You can also look at my videos. If i have time, i'll check it out.

ParisNeo avatar Nov 09 '23 06:11 ParisNeo

@ParisNeo of course :)

I'll take a look! Sounds very interesting

Millu avatar Nov 09 '23 07:11 Millu