AniPortrait icon indicating copy to clipboard operation
AniPortrait copied to clipboard

AniPortrait: Audio-Driven Synthesis of Photorealistic Portrait Animation

Results 109 AniPortrait issues
Sort by recently updated
recently updated
newest added

您好,按照github上给的pretrain_model目录放置好文件后,执行推理时报错,是否需要git lfs 下载所有的文件而不是仅仅下载目录列出的文件呢? 报错信息时加载stable-diffusion-v1-5 这个目录的模型时报错。报错信息如下: pretrained_base_model_path:./pretrained_model/stable-diffusion-v1-5 Traceback (most recent call last): File "/root/miniconda3/envs/aniport/lib/python3.10/site-packages/diffusers/models/modeling_utils.py", line 109, in load_state_dict return torch.load(checkpoint_file, map_location="cpu") File "/root/miniconda3/envs/aniport/lib/python3.10/site-packages/torch/serialization.py", line 815, in load return _legacy_load(opened_file, map_location, pickle_module,...

安装视频地址:https://www.bilibili.com/video/BV1ox421S7hK/

可以较小的L值可以生成完整的视频,现在L值太小的话只会生成前几秒

add a explaination of parameters in video generation scripts.

~/AniPortrait# python -m scripts.pose2vid --config ./configs/prompts/animation.yaml -W 512 -H 512 -L 64 Some weights of the model checkpoint were not used when initializing UNet2DConditionModel: ['conv_norm_out.weight, conv_norm_out.bias, conv_out.weight, conv_out.bias'] /usr/local/lib/python3.10/dist-packages/torch/_utils.py:776: UserWarning:...

Thank you for your excellent work! The flickering in the demo video driven by audio is quite severe. Is there any solution to optimize it?

非常棒,比丑陋的阿里强太多了

I made windows version and it works well. https://github.com/sdbds/AniPortrait-for-windows I improve code for loading local model for safetensors and ckpt,we will not download vae and stable-diffusion-1-5. ![image](https://github.com/Zejun-Yang/AniPortrait/assets/8085926/bfa0b0eb-bc7c-4618-98a3-a8bea5f9d79f)

Thanks for the model and pipelines, superb work! As the technique is based on SD1.5 + AnimateDiff, I was wondering if it would be possible to create a super fast...

同步音频与视频的fps