MotionDiffuse icon indicating copy to clipboard operation
MotionDiffuse copied to clipboard

Published 20 hours ago • verified publisher icon mingyuan-zhang

Evaluation Error

Open kentfuji opened this issue 2 years ago • 4 comments

Hi, thanks for sharing the great work!

I tried to run the evaluation procedure following the instructions in the install.md file and the Evaluation section. However, it seems that the process fails at FID calculation after telling me that there is a NaN value. (The matching score is also nan for the ground truth data as well...) I did download all the pretrained models and placed them where they should be. Do you know what the cause could be? Thank you in advance!

kentfuji avatar Nov 05 '22 05:11 kentfuji

P.S., this only seems to be an issue with t2m dataset. KIT seems to work fine.

kentfuji avatar Nov 05 '22 10:11 kentfuji

Have you solved yet? I am encountering this problem, too.

leinace1001 avatar Apr 28 '23 06:04 leinace1001

Me too，by printing gt,gt_mu,cov and gt_cov,they are all Nan,I guess the problem is the pretraind models! And other projects with HumanML3D also can't evaluate FID.

fyyakaxyy avatar Aug 23 '23 07:08 fyyakaxyy

Me too，by printing gt,gt_mu,cov and gt_cov,they are all Nan,I guess the problem is the pretraind models! And other projects with HumanML3D also can't evaluate FID.

Me too，by printing gt,gt_mu,cov and gt_cov,they are all Nan,I guess the problem is the pretraind models! And other projects with HumanML3D also can't evaluate FID.

fyyakaxyy avatar Aug 23 '23 07:08 fyyakaxyy