IP_LAP

IP_LAP copied to clipboard

如题，也试过用中文数据训练，但是也是同步不好，请问有什么办法可以解决吗？而且嘴唇抖动明显

sunjian2015

Distinguish face appearance and pose

1

Hey, can i somehow distinguish the appearance and the facial pose of the person? (get landmarks from input video, but the face itself from another source, so that it would...

alasokolova

why dataloader is too slow？

3

Thanks for your work！ When I run the training code, the process is too slow，and I found the time is mainly spent on the dataloader. How to solve the problem?

AndrewDing616

Awesome work！I would like to know how to reproduce the performance values in the experimental table 1 of your paper?

3

非常感谢作者您为社区带来的开源贡献！我想知道如何通过您提供的checkpoint来复现您论文中表格1里面的精度数据(以lrs2为例) inference_single.py只提供了一段测试输出的视频，没有提供相应的精度数据~ 

HUAFOR

调用load_checkpoint导致的问题

2

我在训练 landmark_generator时，为了能够从上次中断的地方继续训练，发现调用 load_checkpoint()传入的参数 reset_optimizer=False时，会出现下面的错误 开始 landmark_generator_training****************** Project_name: landmarks Load checkpoint from: ./checkpoints/landmark_generation/Pro_landmarks/landmarks_epoch_1166_checkpoint_step000035000.pth Load optimizer state from ./checkpoints/landmark_generation/Pro_landmarks/landmarks_epoch_1166_checkpoint_step000035000.pth init dataset,filtering very short videos..... 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 49644/49644 [00:04

tailangjun

train landmark generator

9

Hi，请问在训练landmark generator的时候，是需要手动停止吗？因为我看这个while循环的意思似乎没有break的逻辑： ``` https://github.com/Weizhi-Zhong/IP_LAP/blob/main/train_landmarks_generator.py#L303 ``` 如果是这样的话，请问给出的预训练模型是在训练到了多少个step才停下来的 、训练了多久呢 ？感谢。

Gpwner

Is there a plan to have Batch inferencing?

debasishaimonk

How to know N_l:N_l+T is lip_embedding and N_l+T: is jaw_embedding. As used in code below. I am using more no of landmark points. so i need to know how you...

Aditya870

what's the output of landmarks_generator?

1

I find the last shape of output in landmarks_generator is 57, why 57?

sunjian2015

Inquiries about training operations

1

I prepared the materials required for training and executed the training file, and the following error occurred, I don't know how to solve it, please advise I have installed the...

acolasialiuliu