AniPortrait
AniPortrait copied to clipboard
AniPortrait: Audio-Driven Synthesis of Photorealistic Portrait Animation
执行推理报错!
您好,按照github上给的pretrain_model目录放置好文件后,执行推理时报错,是否需要git lfs 下载所有的文件而不是仅仅下载目录列出的文件呢? 报错信息时加载stable-diffusion-v1-5 这个目录的模型时报错。报错信息如下: pretrained_base_model_path:./pretrained_model/stable-diffusion-v1-5 Traceback (most recent call last): File "/root/miniconda3/envs/aniport/lib/python3.10/site-packages/diffusers/models/modeling_utils.py", line 109, in load_state_dict return torch.load(checkpoint_file, map_location="cpu") File "/root/miniconda3/envs/aniport/lib/python3.10/site-packages/torch/serialization.py", line 815, in load return _legacy_load(opened_file, map_location, pickle_module,...
安装视频地址:https://www.bilibili.com/video/BV1ox421S7hK/
可以较小的L值可以生成完整的视频,现在L值太小的话只会生成前几秒
add a explaination of parameters in video generation scripts.
~/AniPortrait# python -m scripts.pose2vid --config ./configs/prompts/animation.yaml -W 512 -H 512 -L 64 Some weights of the model checkpoint were not used when initializing UNet2DConditionModel: ['conv_norm_out.weight, conv_norm_out.bias, conv_out.weight, conv_out.bias'] /usr/local/lib/python3.10/dist-packages/torch/_utils.py:776: UserWarning:...
Thank you for your excellent work! The flickering in the demo video driven by audio is quite severe. Is there any solution to optimize it?
非常棒,比丑陋的阿里强太多了
I made windows version and it works well. https://github.com/sdbds/AniPortrait-for-windows I improve code for loading local model for safetensors and ckpt,we will not download vae and stable-diffusion-1-5. 
Thanks for the model and pipelines, superb work! As the technique is based on SD1.5 + AnimateDiff, I was wondering if it would be possible to create a super fast...
同步音频与视频的fps