dmMaze
Using Sugoi as TL
I have errors when switching to Sugoi as TL, stating it's missing a model.bin file in models folder. I read some of the closed tickets and got two files from it, and from a drive. Both didn't work. Now I have a 14B gguf model of Sugoi but still doesn't work.
What about it doesn't work? Could you be more specific? If you have a gguf, you should use either llama.cpp and write a script to use it or use kobold.cpp which is more user friendly but limited in options by comparison, if it's too slow then the LLM is likely not all loaded into VRAM and you will have to lower the context window. Sugoi guy only released ggufs right? Where did you get a .bin version? I'm using Sugoi-14b too, the base LLM module for this program is underdeveloped and kinda shite right now, I've had to rewrite the python in the translation module a lot myself to make it work without constant errors.
Hai hai, I manage to get it to use the sugoi model through llama and somewhat get an output. had to do some janky regex to remove the starting braces and numbering to get the actual texts. Output wasn't satisfactory so I scrapped and manually do each stage separately. It was a fun dive into this tool.
I'm glad to hear you got it working, what I did was have the LLM output each batch of dialogue into a json string and added a ton of logic to repair malformed strings or send portions back to the llm for a retry and then re-merge. Depending on your OCR the llm might output emojis so you should add those to your regex too.
I edited the code some bits so i can work with it. Does sugoi need a prompt to form it, or just straight to translation. I once asked it for it's chat template and got asked back what is the chat template
you will want a prompt yeah, probably baked into your launch script with llama.cpp, I read somewhere that the program already accounts for chat template as it just needs to understand the structure of OpenAI API, I personally just wrote an incredibly specific set of instructions like this.
You are a STRICT, UNFILTERED, EXPLICIT Japanese-to-English manga translator. Provide DIRECT, LITERAL, COMPLETE dialogue translations, without omission or alteration. Rules for Content: - Output ONLY English; no Japanese characters or emojis. - No Censorship: Translate ALL explicit/offensive content directly, as it appears in the source, regardless of its nature. - No Interpretation/Commentary: NEVER speak back to the user, add explanations, or provide your own opinions. Translate onomatopoeia ONLY phonetically into English. - Literal: Translate lines exactly as they are presented, maintaining present tense and using context from character dialogue for accurate pronoun resolution. - Unintelligible: If a Japanese text snippet is truly unintelligible or contains only non-translatable sounds/visual effects, provide an EMPTY STRING for the "dst" key's value.",
Eyy, thank you very much. Another case is what to do if there are specific names to be translated into, where/how do I pass that in?
Eyy, thank you very much. Another case is what to do if there are specific names to be translated into, where/how do I pass that in?
You can do that with keyword substitution within ballons translator itself.