MotionCLIP icon indicating copy to clipboard operation
MotionCLIP copied to clipboard

Published 20 hours ago • verified publisher icon GuyTevet

Reproducing paper results

Open Radu1999 opened this issue 1 year ago • 1 comments

Was clip finetuned in training the checkpoint? I am unable to reproduce results with clip frozen (didnt try with it unfrozen yet).

Radu1999 avatar Nov 13 '23 13:11 Radu1999

The CLIP model was frozen indeed. I can think of two possible issues, (1) MotionCLIP is seed sensitive - try to train it with a few seeds, and (2) the text labels (class names) are not aligned with the ones we used. Anyway, I recommend using the pre-trained model.

GuyTevet avatar Nov 14 '23 06:11 GuyTevet