Wenqing Wang

code for data processing, training

3

Hi, can you provide the code for data processing and training? Thank you!

CUDA_VISIBLE_DEVICES=0 data_gen/nerf/process_data.sh $VIDEO_ID (missing files and issues)

3

[INFO] ===== extract audio from data/raw/videos/May.mp4 to data/processed/videos/May/aud.wav ===== ffmpeg version 4.2.2 Copyright (c) 2000-2019 the FFmpeg developers built with gcc 7.3.0 (crosstool-NG 1.23.0.449-a04d0) configuration: --prefix=/tmp/build/80754af9/ffmpeg_1587154242452/_h_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho --cc=/tmp/build/80754af9/ffmpeg_1587154242452/_build_env/bin/x86_64-conda_cos6-linux-gnu-cc --disable-doc --enable-avresample --enable-gmp...

bash scripts/infer_lm3d_radnerf.sh (OSError: data/processed/videos/May/ori_imgs/0.lms not found.)

1

| Unknow hparams: [] args.config: checkpoints/May/lm3d_radnerf_torso/config.yaml | Hparams chains: ['egs/egs_bases/radnerf/base.yaml', 'egs/egs_bases/radnerf/lm3d_radnerf.yaml', 'checkpoints/May/lm3d_radnerf_torso/config.yaml'] | Hparams: accumulate_grad_batches: 1, ambient_out_dim: 2, amp: True, base_config: ['egs/egs_bases/radnerf/lm3d_radnerf.yaml'], binary_data_dir: data/binary/videos, bound: 1, camera_offset: [0, 0, 0],...

Hi, I was wondering if geneface++ supports silent audio such that given a silent audio the rendered person does not move lips?

Audio2Motion Training Code Release

2

Hi, I was wondering when will the Audio2Motion training code be released. The previous comments said it'd be around 2024/06/01, would it be any time soon? Thank you!

Hi, for the provided pth/M030.pth file in test.zip, how many epochs did you train for emotion_pretrain, disentanglement, and landmark models?