the lip shakes heavily after training

[MYTHOFLEGEND]

Hello, I trained the landmarks model by the videos I collected from bilibili, running_L1_loss is 0.0066 and running_velocity_loss is 0.0048. but in the inference result, the lip shakes heavily and mismatch with the upper face

https://github.com/Weizhi-Zhong/IP_LAP/assets/48516484/bddc213a-cc13-41bf-b349-c602e4888a7a

could you give me some suggestions to fix that? Thanks very much!

[Bonfireee]

同样存在这个问题，不过我安装的一些库可能跟作者在requirements列的不太一样，不知道是不是这个原因。请问你是按照作者给的requirements安装的环境吗？

[MYTHOFLEGEND]

不是，我都是尽量装的最新，pytorch用的2.0.1，直接用作者的模型推理就没事，自己训练的就会出现这个问题

[Samkulin]

我用预训练模型都会抖

[komilaria]

@MYTHOFLEGEND hello bro!! how to get separate video or separate video for show_sketch and separate video for full

[komilaria]

do you have any ideas to improve resolution?

[qwert1887]

@MYTHOFLEGEND Hi! If possiable, Can you tell me what you used to remove the background in your video.I'm very interested in this.Thanks in advance.

[sunjian2015]

上下对不上可能是因为推理和训练时 crop 人脸时设置的 pad 不一致导致的，这个代码里处理数据时是 5，推理时是 25

[xiaomaofei]

这真的好抖