motion-latent-diffusion icon indicating copy to clipboard operation
motion-latent-diffusion copied to clipboard

Results Stage1 KIT Dataset

Open AlessioSam opened this issue 2 years ago • 3 comments

Hi, thank you for your work, I find it brilliant and really useful for future developments in this field!

Regarding the HumanML3D dataset, the results are easily replicable. However when trying to train the model on the KIT dataset I am having trouble getting your results, similar to issue #44.

  • I changed as you rightly said in a previous issue (#13) some lines in the config ('humanml' -> 'kit'), leaving the field JOINT_TYPE: 'humanml3d' unchanged.
  • I have repeatedly checked that I have downloaded the correct dataset and dependencies.

In stage1, what happens is that the model seems not to learn to reconstruct joints and features.

Is it possible to have your checkpoint so I can check that indeed the dataset is not corrupted? Or if you have any other advice (hyperparameters, ...)

After 20k epochs I have: FID: 26.7 R_precision_top_1: 0.199 AVE_mean_pose: 2145 AVE_mean_joints: 79551

In contrast, the metrics for GT are correct.

Looking forward to your reply! Thanks, Alessio [email protected]

AlessioSam avatar Aug 25 '23 13:08 AlessioSam

@AlessioSam I have the same problem, have you solved it?

weleen avatar Oct 26 '23 11:10 weleen

@weleen @AlessioSam Hi Weleen and AlessioSam, could you provide more details about this implementation? The FID metric shows that this training is broken. Is there anything about loss?

ChenFengYe avatar Oct 26 '23 11:10 ChenFengYe

@ChenFengYe image This is my test results.

weleen avatar Oct 27 '23 05:10 weleen