animatable_nerf icon indicating copy to clipboard operation
animatable_nerf copied to clipboard

Testing Pretrained Models

Open ChenYutongTHU opened this issue 1 year ago • 4 comments

Hi authors,

I have an issue of evaluating the provided pretrained models. Following https://github.com/zju3dv/animatable_nerf/issues/63, I downloaded the vanilla animatable NeRF models, aligned_aninerf_lbw_${sub}, and run the command for test, according to https://github.com/zju3dv/animatable_nerf/blob/master/test.sh

# Vanilla Animatable NeRF
python run.py --type evaluate --cfg_file configs/aligned_nerf_lbw/aligned_aninerf_lbw_${sub}.yaml exp_name aligned_aninerf_lbw_${sub} resume True
python run.py --type evaluate --cfg_file configs/aligned_nerf_lbw/aligned_aninerf_lbw_${sub}.yaml exp_name aligned_aninerf_lbw_${sub}_full resume True aninerf_animation True init_aninerf aligned_aninerf_lbw_${sub} test_novel_pose True

However, the resulted metrics are somehow different from the reported ones in NeuralBody-TPAMI. image

For example, for subject 393 (Swing3), the reported novel-view scores are PSNR=27.53, SSIM=0.925, the yielded scores of the downloaded model, aligned_aninerf_lbw_393/latest.pth are PSNR=25.58, SSIM=0.9121

Is there any reason for this? (For example, the dataset was updated)

ChenYutongTHU avatar Feb 15 '24 16:02 ChenYutongTHU

I see aligned_aninerf_lbw_${sub}.yaml uses data/light_stage while configs/aninerf_${sub}.yaml uses data/zju_mocap. Is there any difference between light_stage and zju_mocap?

ChenYutongTHU avatar Feb 15 '24 16:02 ChenYutongTHU

There is no difference between two data.

pengsida avatar Feb 16 '24 13:02 pengsida

Thanks! Are rendered images with the reported scores available? If the released model cannot reproduce the reported scores on my machine, it would be great to access the rendered results directly.

Thank you :)

ChenYutongTHU avatar Feb 26 '24 13:02 ChenYutongTHU

Also, can you help provide the init_sdf model, which seems to be needed in the Ani-SDF method. Great thanks!

ChenYutongTHU avatar Feb 26 '24 17:02 ChenYutongTHU