Silent-Hill-2-Enhancements icon indicating copy to clipboard operation
Silent-Hill-2-Enhancements copied to clipboard

About remove kanji area from font000

Open toraMeeKay opened this issue 1 year ago • 60 comments

Kanji characters are not displayed when custom fonts are enabled. Could you please restore the remove kanji area (4400x9600)?

Sorry for my bad English

1 2 3 4 5 6

toraMeeKay avatar Aug 23 '22 12:08 toraMeeKay

We originally made the HD font sheet smaller by removing most of the kanji characters since Silent Hill 2 PC did not include Japanese .mes files. (This was also done to reduce the file size of the HD font sheet. ) We can certainly look into restoring the entire font sheet for use if you have fully restored the Japanese language option.

@belek666 is the creator of the HD font for SH2 PC, so we would need his help/response. Belek: Could you work with me to make this happen?

@toraMeeKay I have a few questions about the screenshots you shared:

  • Did you create the HD Japanese characters seen in these images?
    • If so, did you do this for all the Japanese characters in the font sheet?
    • If so, may I have a copy of this font sheet?
  • The original issue with SH2 PC is that it did not include Japanese .mes files. Did you create *_j.mes files that are fully functional with SH2 PC?
    • Did you have to modify sh2pc.exe in any way to restore the Japanese language? Or was this purely done by fixing the *_j.mes files?

Polymega avatar Aug 23 '22 13:08 Polymega

If so, did you do this for all the Japanese characters in the font sheet?
If so, may I have a copy of this font sheet?

Yes I edited. font0000.zip

Did you have to modify sh2pc.exe in any way to restore the Japanese language? Or was this purely done by fixing the *_j.mes files?

there is no need to modify sh2pc.exe to restore the Japanese language.

More than 12 years ago, it was discovered that extract a text file (*j_mes files) from the ETC.MGF file of the PS2 Japanese version and replace it with the files of the PC version, it can be translated into Japanese. The mes files extraction tool was created about 11 years ago.

https://wikiwiki.jp/nihongoka/%E3%83%9E%E3%83%AB%E3%83%81%E3%83%A9%E3%83%B3%E3%82%B2%E3%83%BC%E3%82%B8/n-z#f5say43r

https://www.youtube.com/watch?v=Y3_Fd4xNV8w

toraMeeKay avatar Aug 24 '22 04:08 toraMeeKay

Yes I edited.

Thank you very much for providing this font sheet. I'm not at my computer at this time, but I will look at it later.

If you made this font sheet in Photoshop, would you be okay to send me your working file (along with the font you used)?

it was discovered that extract a text file (*j_mes files) from the ETC.MGF file of the PS2 Japanese version and replace it with the files of the PC version

Oh, excellent! We have wanted to include the fully restored Japanese language into our project for a long time now. I'm happy to hear we can now do this.

Would you be able to ZIP all of the restored SH2 PC *_j.mes files for me? If not, I can look into using the extraction tool myself. You sending these files would save me time.

I will reach out to belek666 so we can start using the full font sheet since the Japanese language will now be working again. :) I will keep you updated on this progress.

Polymega avatar Aug 24 '22 05:08 Polymega

I will reach out to belek666 so we can start using the full font sheet since the Japanese language will now be working again. :) I will keep you updated on this progress.

Thank you very much for kind response!! I sent you an email.

toraMeeKay avatar Aug 24 '22 09:08 toraMeeKay

Got your email! I will work on this soon.

@IlDucci Here are the Japanese message files provided by toraMeeKay: SH2 JP mes Files PS2 Rip.zip

I want to go into these files and fix a few things to bring them up to compliance with our project. When I use SH2MSGConvert on these files, I receive the following error from the tool:

[ERROR DUMP .mes]  ERROR Unkown bytes 2D 35 address 3048

Is there an extra setting I need to do with the tool to make it work with this language, as I remember you saying something to the effect of this language using 2 bytes (?) for its character encoding?

Thanks

Polymega avatar Aug 24 '22 13:08 Polymega

That means problems. I did a quick, cursory check at the files...

Back when Infrid and I did the tests for the sh2msg tool and I asked you to verify the Japanese character set, we used the PAL version's Japanese texts as the reference to get the character table decoded. But some of those files seem to be different with the ones delivered in this dump, which I presume is from an actual NTSC-J version of the game.

So the error means, that character is not in our table because it apparently did not exist in the PAL version. Meaning: I need to find out any additional characters in this dump and add them. Give me a bit of time to find out the offending characters.

IlDucci avatar Aug 24 '22 16:08 IlDucci

Update on the situation: only three files have issues: config_pc, m_card_x and option. Seeing issues at config_pc, a file that should not be around the PS2 version (I think), makes me think that those files have been altered in a way that is not compatible with sh2msg tool:

I think the three stopping points happen at places where English text should start, so maybe the bytes that indicate if a text should be in English or Japanese are misadded: at config_pc and option the error is caused when the string "Turn Left" shows up and at the m_card_x, seems like the offending string is "MU" (Memory Unit).

I'll ping @Infrid so he can take a look at those files and have a better look at them, but that's what I think is going on. @toraMeeKay , have you changed the files with that Japanese tool you have mentioned?

IlDucci avatar Aug 24 '22 16:08 IlDucci

Ah, the one file I tested with your tool was m_card_x.

only three files have issues: config_pc, m_card_x and option. [...] those files have been altered in a way that is not compatible with sh2msg tool:

These .mes files very likely ~~have added~~ do NOT have the added, PC-specific strings in them, so that may be why these ones are breaking? Theoretically, all other files should be the same as they're the "normal gameplay" .mes files. So nothing would need to be changed between versions for the other .mes files.

I asked you to verify the Japanese character set, we used the PAL version's Japanese texts as the reference to get the character table decoded

You probably remember this better than I, but wasn't the issue that the PC version dummied out most/all of the Japanese text strings? And that's why we never included them previous to this discussion?

Polymega avatar Aug 24 '22 16:08 Polymega

These .mes files very likely ~have added~ do NOT have the added, PC-specific strings in them, so that may be why these ones are breaking? Theoretically, all other files should be the same as they're the "normal gameplay" .mes files. So nothing would need to be changed between versions for the other .mes files.

That should break the PC version, not the tool. On that regard, the tool simply counts the amount of strings and adds a number to the text file in order to avoid mistakes by editors. The error that shows up is a character encoding one, not a number of strings one.

I do recall that there can be two encodings in a .mes file: Japanese (two-byted) and Western (one-byted with 2/3 bytes for Japanese characters). If I do recall correctly, in order to change encodings, you need to add an extra flag at the beginning of a string, which is probably what is missing here, since the faulty lines are English one-byted texts. Again, I'll wait until Infrid confirms that.

You probably remember this better than I, but wasn't the issue that the PC version dummied out most/all of the Japanese text strings? And that's why we never included them previous to this discussion?

Sorry, I meant the PS2 PAL version of the game as the source of the Japanese assets I asked you to verify. All PS2 versions include the Japanese .mes files, even if the language itself cannot be selected. But yeah, EE did not add the Japanese language primarily because of the dummied out strings/lack of translation for any changes done for EE/lack of translations for the PC version's new strings/lack of HD font.

IlDucci avatar Aug 24 '22 16:08 IlDucci

Sorry, I meant the PS2 PAL version of the game as the source of the Japanese assets I asked you to verify.

Oh wow, this was quite a while ago. I think I remember sending this to someone whose fluent in Japanese and they quickly looked over all the files. So maybe the strings weren't dummied out? (At lease for SH2 PC European files?) And if that's the case, we could use the PAL .*_j.mes files since we know they all work?

Now that we have a complete font sheet (thanks to toraMeeKay) all that would be left to do is clean up the files and do any file translations for PC-unique strings?

...this is all contingent on whether or not the PAL version of SH2 PC included complete Japanese files (which I honestly can't remember at this point in time...).

Polymega avatar Aug 24 '22 17:08 Polymega

Yes, you helped me with that. The Japanese language from the PS2 PAL was verified by someone who came to your call (which I'm grateful for). However, the SH2 PC version does have the Japanese language dummied out.

  • PS2 and XBOX have the Japanese assets intact, they just have the language removed from the Options menu.
  • PC's PAL version has dummied Japanese mes files.

So yes, we could just clean up the files with what we got. Here's the XBOX Japanese text assets in sh2msg format. Please tell me if I should remove them or something: messageJPNXBOX.zip

IlDucci avatar Aug 24 '22 17:08 IlDucci

Awesome. Thanks so much, IlDucci.

@toraMeeKay The ZIP file IlDucci provided are the Japanese .mes files taken from the Xbox version of the game. All the files from the Xbox version should be compatible with the SH2MSGConvert tool, so there should be no errors like what happened with the PS2 extracted files.

The Xbox version might even be better for us since the PC version is based on the Xbox version. So I'm hoping there's even more compatible text strings for use with the PC version.

I will be periodically messaging you here for help with translating PC-specific strings that the Japanese .mes files may not already include. I will probably also need your help playtesting all of this once everything is done, to make sure all the text strings are correct and accounted for while playing.

Polymega avatar Aug 24 '22 18:08 Polymega

@toraMeeKay I sent you an email to become an editor for the Google Document below (@IlDucci: I also made you an editor for this document): https://docs.google.com/document/d/1ET5iIFOjT9YCjejKk2wqa_YVn8itFnUns7Rp76AhCNs/edit?usp=sharing

In this document, you will find the text strings that we will need translations for. The left column are the English strings (for reference) and the right column is for you to input the Japanese translations.

  • If an English string is highlighted in yellow:
    • We will need a translation.
  • If an English string is highlighted in gray:
    • This can be ignored.

Please preserve the --------------- lines. Along the way, you will find things like <VARIABLE-##> and <COLOR-XXX>. These will also need to be preserved and placed appropriately in your translation lines.

There are some elements in the game that were never translated into Japanese, such as the selections in the Options menu, that we now have the opportunity to translate for Japanese players. 😊

Some of these strings are already translated in Japanese. You can reference the Xbox version of these .mes files (below) to copy + paste already completed strings, if you'd like.

Thank you for your help!

Polymega avatar Aug 24 '22 23:08 Polymega

I'll use a diff to check what strings can be copied from the XBOX/PS2 version.

In the meantime, there's something puzzling me... It's the limit for the two strings in the Save/Load menu. Can you verify the limit is character-based and not byte/memory-based? Because in that case, the amount of characters available for Japanese could be half or even less.

IlDucci avatar Aug 25 '22 11:08 IlDucci

Okay, I've pasted all the strings that had none or very little changes in English. Since the tool detects the .mes files as Japanese, make sure the variables include the "-LE" part (I have added them).

IlDucci avatar Aug 25 '22 11:08 IlDucci

@Polymega, Thank you as always for your help. I appreciate too @IlDucci for creating such a wonderful tool! Shamefully enough, I didn't know about sh2msg...

Based on the ideas you provided, as long as my ability can reach, I translated them into Japanese. I also did some test play. I hope it's fine...

toraMeeKay avatar Aug 25 '22 12:08 toraMeeKay

Thank you for helping out! I have seen two things, though:

  • @Polymega , did you do the "Strafe" typo here?
---------------
Strage left
---------------
Strage right
---------------
  • @toraMeeKay , the following strings are missing:
---------------
Set software 3D sound quality
---------------
Enable Dolby Digital 5.1 sound
---------------
---------------
Introduction Collage - Voice Version
---------------
James finds Laura on the wall
---------------
James meets Maria on the waterfront
---------------
Hotel flashback
---------------
Maria and James in the hospital
---------------
Maria behind bars
---------------
Eddie on the floor
---------------
Eddie confronts James
---------------
The videotape of Mary
---------------
Maria - Ending
---------------
Rebirth - Ending
---------------
In Water - Ending
---------------
Leave - Ending
---------------
Born From a Wish - Ending
---------------
DOG - Ending
---------------

I suppose the two first strings are an issue of unseen texts on EE (Polymega should confirm that), but are the rest of them left in English because a Japanese reader can read those or simply because you do not have a saved game with all the movies unlocked? Because those should be seen. You can find a 100% unlocked save game here.

IlDucci avatar Aug 25 '22 13:08 IlDucci

I'm working on this as we speak! Give me a moment. :)

Polymega avatar Aug 25 '22 13:08 Polymega

Thank you both!

@toraMeeKay Please see this document again: https://docs.google.com/document/d/1ET5iIFOjT9YCjejKk2wqa_YVn8itFnUns7Rp76AhCNs/edit#

  • config_msg_j.mes

    • We need translations for all of these text strings, please.
  • Lines that are highlighted bright blue:

    • We will need translations for this, please.
  • Lines that are highlighted bright green:

    • These strings technically do not need to be translated, as they are English in the other versions, but they could be translated to further assist Japanese players. Would you like to translate these lines?
  • Lines that are highlighted in red:

    • Important notes to review.

@IlDucci

but are the rest of them left in English because a Japanese reader can read those or simply because you do not have a saved game with all the movies unlocked?

It might be good for toraMeeKay to translate these lines (highlighted in green and blue in the document). A lot of these lines are still in English for the Japanese PS2/Xbox releases, but if we have the capability to translate them to make things easier for Japanese players, then would should do it.

Since the tool detects the .mes files as Japanese, make sure the variables include the "-LE" part (I have added them).

I pasted in toraMeeKay's work so far into that document. I might have accidentally overwrote your "-LE" changes. Please verify.

Polymega avatar Aug 25 '22 14:08 Polymega

I sent you an email invite to edit this document, toraMeeKay. If it's easier for you, you can edit directly in this document then copy it over to a .txt file. IlDucci and I can look over the .txt file to ensure it's formatted correctly for use with the SH2MSGconvert tool.

Polymega avatar Aug 25 '22 14:08 Polymega

  • Lines that are highlighted bright green:

    • These strings technically does not need to be translated, as they are English in the other versions, but they could be translated to further assist Japanese players. Would you like to translate these lines?

I have not said that much regarding many English strings in Japanese because I know that many simple or menu type texts are, indeed left in English as-is (or slightly reworded into what we might call Engrish) in Japanese games/game translations.

I pasted in toraMeeKay's work so far into that document. I might have accidentally overwrote your "-LE" changes. Please verify.

Everything seems to be okay on that regard (only XOFFSET and VARIABLE need the -LE extension for Japanese/Asian languages).

IlDucci avatar Aug 25 '22 14:08 IlDucci

I have not imported the EE-exclusive files into the game (these tests were done with just the XBOX mes files) but I can confirm that @toraMeeKay 's HD font does work with some tweaks, as converted in here: imagen imagen imagen

IlDucci avatar Aug 25 '22 15:08 IlDucci

By the way: This new font sheet is a work-in-progress. I will very likely need to pixel-shift some characters around. I will also make the "..." look better.

image

Polymega avatar Aug 25 '22 15:08 Polymega

@Polymega, @IlDucci, @belek666 I'm totally moved! and I'm eternally grateful for everyone.

the following strings are

Sorry, I hadn't checked thoroughly... and I added japanese translation that you pointed out text. also I fixed font a little. JPtranslated2.zip *Even in the Japanese version, I have not changed the points written in English and the points that have not been confirmed.

and I would like to check two points.

[VERIFY IF WORD “ALTERNATE” IS NEEDED.]

The original Japanese text of the CS version is written as it is, but should I add "ALTERNATE" ? *In Japanese notation, "ALTERNATE" becomes "(裏)"

[translation must be 27 characters or less][MISSING TRANSLATION]

This points is displayed without any problem, but is there any problem? save

toraMeeKay avatar Aug 25 '22 18:08 toraMeeKay

[VERIFY IF WORD “ALTERNATE” IS NEEDED.]

The original Japanese text of the CS version is written as it is, but should I add "ALTERNATE" ? *In Japanese notation, "ALTERNATE" becomes "(裏)"

The Enhanced Edition altered those location names to include the reference that James is in the alternate dimension. I just checked with the original files and it is an addition by @Polymega , so this is a discussion that I should leave to him.

This points is displayed without any problem, but is there any problem?

There is a bug in the PC version which causes visual glitches whenever entering this screen during gameplay, not from the main menu, and for now it is only solved by reducing the amount of characters used. You have more information in the Language Translation Guide for EE, if you want to take a read on the changes and differences.

Oh! And you have not given us a translation file for config_pc. Are you sure you want to leave everything there in English?

IlDucci avatar Aug 25 '22 18:08 IlDucci

More comments on your texts:

<VARIABLE-01-LE>ボタンで削除できます This string does not have a variable for the PC version, just the Backspace key. Can you please update this string removing the variable and adding the key name in Japanese?

続けるには決定ボタンを押してください Sorry about this, but I am using DeepL to verify the text and seems to be reading "Decide Button". For the PC version, it was changed to "Return", as in the Return key of the keyboard. Can you please confirm this is a mistake on my verification or if the string does need change?

SILENT HILL 2 Save Files Another change from XBOX to PC, as in PC there is just "one location" for saved files. Should I leave this in English?

IlDucci avatar Aug 25 '22 18:08 IlDucci

The original Japanese text of the CS version is written as it is, but should I add "ALTERNATE" ? *In Japanese notation, "ALTERNATE" becomes "(裏)"

The Enhanced Edition altered those location names to include the reference that James is in the alternate dimension. I just checked with the original files and it is an addition by @Polymega , so this is a discussion that I should leave to him.

As you know, the Silent Hill games have an alternate (or "Otherworld") location. Please use whatever Japanese notation you think is best to describe this. 😊

This points is displayed without any problem, but is there any problem?

We will test this later and let you know!

Oh! And you have not given us a translation file for config_pc. Are you sure you want to leave everything there in English?

Yes, please consider translating this file as well! You can find this file at the top of this document link. If you'd like, you can edit this document directly (I sent you an invitation email to edit the document).

If you are okay in doing so, it might be easier to make your changes in this document first. That way, we can collaborate in real-time.

Polymega avatar Aug 25 '22 18:08 Polymega

also I fixed font a little. JPtranslated2.zip

May I ask you to email me the native PSD with the updates?

Polymega avatar Aug 25 '22 19:08 Polymega

Hello, I have been stalking the discussions going on in the project's Github (I absolutely adore seeing the work you guys do) and I thought I could point something out that is pertinent to this issue. Very rarely do Japanese video games feature everything written in Japanese because of what can be described as cultural reasons. This website has a great section discussing this. Even games made by Western studios that get localized to Japanese do not fully translate everything, this video has great examples of that in GTA San Andreas where they kept various strings in English but reworded them with more common words that Japanese people are very likely to understand. This is the reason the Japanese version of SH2 has a lot of strings in English rather than having it 100% in Japanese, thus I believe it would be a good idea to think more about this and consider whether things like the settings screen and video selection menu really need everything in Japanese.

matheusvb3 avatar Aug 26 '22 01:08 matheusvb3

Very rarely do Japanese video games feature everything written in Japanese because of what can be described as cultural reasons. This website has a great section discussing this.

Ah, fantastic. This is good to know, and thanks for the tips/useful links, Matheus! (Also, from quickly looking over the site, I will be reading more from Legends of Localization... quite interesting articles!) So knowing this, we're pretty close to having this finished for SH2 PC. toraMeeKay and IlDucci kept most everything that was already in English preserved in English.

There are three lines still in the m_card_msg_j.mes file (unique to the PC version) that may benefit from a translation though:

  • Delete file with Backspace
  • Press Return to continue
  • SILENT HILL 2 Save Files

But that leaves the question: Should config_pc_msg_j.mes be translated at all or left fully in English? This is a file unique to the PC version.

Polymega avatar Aug 26 '22 02:08 Polymega