AniPortrait issues

Does it work on CPU?

1

It's not on topic. but I started using a computer in the year 2000 and developed optimization methods. From 2013 to 2021 I dedicated myself to becoming a beta tester....

Codigohispano

安装并执行audio2vid成功，但在执行vid2pose时报错： ```shell # python -m scripts.vid2pose --video_path 2fe655a671ecb61f93d54d6ad2729951.mp4 WARNING: All log messages before absl::InitializeLog() is called are written to STDERR W0000 00:00:1711714173.841578 36856 face_landmarker_graph.cc:174] Sets FaceBlendshapesGraph acceleration to xnnpack by...

afatpig

Face reenacment inference error

4

CUDA_LAUNCH_BLOCKING=1 python3 -m scripts.vid2vid --config ./configs/prompts/animation_f acereenac.yaml -W 512 -H 512 /usr/local/lib/python3.10/dist-packages/diffusers/utils/outputs.py:63: UserWarning: torch.utils._pytree._register_pytree_node is deprecated. Please use torch.utils._pytree.register_pytree_node instead. torch.utils._pytree._register_pytree_node( /usr/local/lib/python3.10/dist-packages/diffusers/utils/outputs.py:63: UserWarning: torch.utils._pytree._register_pytree_node is deprecated. Please use torch.utils._pytree.register_pytree_node instead....

xiaoxiaolai

推理结果为噪声

3

> solo_solo_pose1_512x512_3_1438_noaudio.mp4 > 我们复现了您反馈的问题。触发条件没有正确加载我们预训练权重，导致模型参数跟我们的任务不匹配。您可以重新下载我们的预训练模型，并确保其位于正确路径下，详情参考README.md。 https://huggingface.co/ZJYang/AniPortrait/tree/main 感谢您的回复，请问复现的这段视频是哪部分模型参数没有加载正确呢？我参考了本repo中的预训练模型目录，我的目录如下，看上去和您给的readme一致： ![微信截图_20240329151007](https://github.com/Zejun-Yang/AniPortrait/assets/41713524/4177e8c4-0e12-40a1-9b5c-c2f2924aacd3) _Originally posted by @fredkingdom in https://github.com/Zejun-Yang/AniPortrait/issues/35#issuecomment-2026791762_

fredkingdom

感谢EMO就是多余了

1

在ai赛道，阿里什么都没做。只会信手捻花别人的开源，然后改进，闭源发布，简直就是开源社区的毒瘤，一点贡献都没有，尽恶心人。跟腾讯比。简直差了十万八千里，我都怀疑，阿里是不是被爷爷送给孙子了。做事风格尽显孙子样

wibur0620

Update README.md

1

reenacment -> reenactment

eltociear

Update README.md

Yuan-ManX

Audio driven推理出来的视频为噪声

7

Audio driven推理官方的demo，float16精度下，生成视频数据为nan；将精度改为float32后，生成视频数据不为nan，但是视频是噪声。能生成landmark视频。 ![噪声图片](https://github.com/Zejun-Yang/AniPortrait/assets/58095417/de43e798-3cf2-4b55-9b33-2bebbbebe42e)

HuaizeLiu