FaceFormer icon indicating copy to clipboard operation
FaceFormer copied to clipboard

[CVPR 2022] FaceFormer: Speech-Driven 3D Facial Animation with Transformers

Results 78 FaceFormer issues
Sort by recently updated
recently updated
newest added

The work is remarkable. How to FaceFormer output arkit blendshape coefficient instead of vertices? Very Thanks.

Amazing work! could you plz guide me where to find templates.pkl ? for BIWI, it is here: FaceFormer/BIWI/templates.pkl however I can not find it for vocaset. Looking forward to hearing...

Hello, I want to add other expression parameters. I want to know how to use flame as the decoder. Thank you for your answer.

Hi, I find that batch_size = 1(refer to [link](https://github.com/EvelynFan/FaceFormer/blob/main/data_loader.py#L100)). Is there any reason? I think it may be faster with a larger batch_size

I have successfully ran the training code based on vocaset. But both for the visualization and the demo's rendering, it keep telling me that the failed rendering frame while running...

AttributeError: 'NoneType' object has no attribute 'glGetError'

python demo.py --model_name biwi --wav_path "demo/wav/test.wav" --dataset BIWI --vertice_dim 70110 --feature_dim 128 --period 25 --fps 25 --train_subjects "F2 F3 F4 M3 M4 M5" --test_subjects "F1 F5 F6 F7 F8 M1...

The result video has mouth-only motion when I use pre-trained model. But when I use the model trained by myself, the result has whole-face motion. (vocaset)

/python3.10/site-packages/psbody/mesh/serialization/serialization.py", line 435, in load_from_ply raise SerializationError(e) psbody.mesh.errors.SerializationError: Failed to open PLY file.