Whether pytorch3d can fit a colored face mesh by an input RGB face mask?

[SwordHolderSH]

(The "rendered image" shown in the above figure is the result of covering the rendered mesh image on the target mask.)

I want to optimize the source face mesh according to the target mask. I built a loss between the rendered image and the target mask, however, the mesh and vertices have not changed.

I would like to ask whether pytorch3d can optimize the color face mesh according to the input RGB mask?