TM2D icon indicating copy to clipboard operation
TM2D copied to clipboard

Questions about MPD and Freezing Score (PFF and AUC) and FID in the paper.

Open MingCongSu opened this issue 5 months ago • 9 comments

Hi @Garfield-kh, thanks for the great work. I am curious about the metric you proposed and have 3 questions.

  1. How to evaluate the MPD and Freezing Score (PFF and AUC) in your code?

  2. What do you mean about the following description in "4.2. Evaluation on Music-text Conditioned Dance Generation" in the paper?

    We use the past 25 motion frames to predict the future 30 frames, and calculate the MPD from future frame (ft) = 10 to ft = 30, respectively.

    i.e. how do you calculate the MPD from future frame (ft) = 10 to ft = 30 and present the result in Table 2? cause I cannot map this to the definition of MPD.

  3. How do you evaluate the FID for in-the-wild music in Table 1? As you mentioned in "4.3. Evaluation on Music Conditioned Dance Generation":

    This is because FACT [30] and Bailando [47] requires seed motion, however, there is no ground-truth for in-the-wild scenario.

It would be of great help if you could reply. Thanks.

MingCongSu avatar Jan 23 '24 15:01 MingCongSu