VRM4U icon indicating copy to clipboard operation
VRM4U copied to clipboard

VRM1: Missing first thumb bone in the generated IK Rigs' Retarget Chains

Open andreiagmu opened this issue 1 year ago • 3 comments

Unreal Engine v5.4.4 VRM4U v20241007

Describe the bug After importing a VRM1 avatar, I noticed that in all of the generated IK Rigs (Mannequin, MannequinBone, VrmHumanoid, UEFN), the first thumb bone (on both thumbs) isn't part of the thumbs' Retarget Chains. In VRM0, the first thumb bone is included in the thumbs' Retarget Chains, in all of the generated IK Rigs.

Is there any reason for this change in VRM1? Based on my animation retargeting experiments, the retargeted thumbs look unnatural when the first thumb bone is excluded from the retargeting. After I add it again to the Retarget Chains (just like in VRM0), the thumbs look more natural in the retargeted animations.

VRM0 IK Retargeter

capture_20241105_214108_018_edit

VRM1 IK Retargeter

capture_20241105_214130_019_edit

VRM0 IK Rig (Mannequin)

capture_20241105_214245_020_edit

VRM1 IK Rig (Mannequin)

capture_20241105_214250_021_edit

andreiagmu avatar Nov 06 '24 02:11 andreiagmu

Here are screenshots of some retargeted animations.

On each screenshot pair, the first image has the first thumb bone excluded from the Retarget Chain (the current behavior from VRM1 import), and the second image has the bone added again to the Retarget Chain (just like in VRM0 import).

In my opinion, the thumbs look more natural when the first thumb bone is added back to the retargeting process. It's very noticeable in the last animation I display here (Anim_KA_Idle08_ComeUpWithAnIdea, from Kawaii Animations 100).


Reference pose - from the VRM4U IK Retargeter (generated on avatar import)

capture_20241105_235839_025

capture_20241105_235912_026


MF_Idle - from UE5 Third-Person Template (ignore the thumb clipping into the clothes)

capture_20241106_000312_027

capture_20241106_000338_028


MM_Walk_InPlace - from UE5 Third-Person Template

capture_20241106_000433_029

capture_20241106_000500_031


Anim_KA_Idle08_ComeUpWithAnIdea - from Kawaii Animations 100 (when the first thumb bone is excluded from the Retarget Chain, the retargeted thumb goes to the avatar's mouth)

capture_20241106_001125_034

capture_20241106_001150_036

capture_20241106_001222_037

capture_20241106_001237_038

andreiagmu avatar Nov 06 '24 03:11 andreiagmu

Hi. Thanks for the report. This will be fixed in the next release.

ruyo avatar Nov 07 '24 13:11 ruyo

The thumb bone Retarget Chains have been fixed in the IK_avatarName_Mannequin and IK_UEFN_avatarName_Mannequin IK Rigs, thanks!

But the IK_avatarName_MannequinBone and IK_avatarName_VrmHumanoid IK Rigs are still inconsistent with their VRM0 equivalents.


In the following screenshot pairs, the first image shows the VRM0 IK Rig, and the second image shows the VRM1 IK Rig.


IK_avatarName_MannequinBone

capture_20241111_220603_001_edit

capture_20241111_220607_002_edit


IK_avatarName_VrmHumanoid

capture_20241111_220610_003_edit

capture_20241111_220613_004_edit

andreiagmu avatar Nov 12 '24 01:11 andreiagmu