Audio2Gestures icon indicating copy to clipboard operation
Audio2Gestures copied to clipboard

Audio2Motion Official implementation for Audio2Motion: Generating Diverse Gestures from Speech with Conditional Variational Autoencoders.

Results 14 Audio2Gestures issues
Sort by recently updated
recently updated
newest added

Hi! Could you please give some step by step guidance or point to some resources on how you retarget the trinity speech dataset into SMPLX? Thanks!

挺好的一份工作,就是数据处理这块的介绍实在是太少了,想跑起来这份代码太困难了。如果作者愿意把数据处理这一块写得更加的详细,我相信这份代码的收藏量会提高一个量级的。

File "/Users/alexandrrezanov/inworld/gestures/audio2gestures/model.py", line 171, in __init__ self.smpl_model = SMPLXModel(args.smpl_path) File "/Users/alexandrrezanov/inworld/gestures/audio2gestures/model.py", line 44, in __init__ meta_betas, data_struct["shapedirs"] File "/Users/alexandrrezanov/inworld/gestures/audio2gestures/utils.py", line 659, in blend_shapes blend_shape = torch.einsum("bl,mkl->bmk", [betas, shape_disps]) File "/Users/alexandrrezanov/opt/anaconda3/envs/audio2gesture3.7/lib/python3.7/site-packages/torch/functional.py",...

Hi, I have got Trinity dataset, how can I retarget the data into SMPLX model using maya? I don't see the official maya version of SMPLX, only the maya version...

Can you share the pretraining model of speech2gesture dataset?

你好,非常荣幸能看到这么富有创造力的工作。我在你的代码中看到数据集似乎可以选择speech2gesture,我到目前为止还未获得Trinity数据集许可,我想请问下是否可用speech2gesture数据集进行训练?因为在read me中没有看到相关介绍,所以来打扰你了。

Hi, could you share the pre trained models and a script for inference? I would like to try your model on a custom audio!

Hi, there! I could not find the training and testing data and pre-trained model to have a try. Would you mind releasing the training and testing data and pre-trained model?