PuLID icon indicating copy to clipboard operation
PuLID copied to clipboard

🤔 PuLID doesn't support anime faces. 📄PuLID warning: No faces detected

Open NeoAnthropocene opened this issue 1 year ago • 1 comments

âš  Just a heads-up for other creators like me who want to use the PuLID in their workflows: it doesn't support anime and animal faces. InstantID can detect at least the anime character faces.

âť“ It seems like the EVA CLIP is already handling the face detection. I'm curious though if there's a way to make it even better at face detection like the InstantID method does.

image

đź”— Reference to the images that fails on PuLID face detection:

  • https://civitai.com/models/648943/silkysaido
  • https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/b163f5ad-0e89-4256-95b3-cd5ec661b8bc/anim=false,width=450/ComfyUI_37219_.jpeg
  • https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/19229a6d-0977-4d83-a577-36994371fb53/anim=false,width=450/dfba8ad2-7b90-4d49-add9-074bd40fd025.jpeg
  • https://civitai.com/images/34265864

W5965YFPRFY8QX4T02NX9WP680 ComfyUI_37219_ download (3) dfba8ad2-7b90-4d49-add9-074bd40fd025

NeoAnthropocene avatar Oct 18 '24 09:10 NeoAnthropocene

in paper, the authors mentioned that they use some "human face recognition" network to extract the face's feature and embed original ID face's feature during training, so it is why it won't work for animal, object or anime. I wonder can we avoid this issue by using some "everything-recognition" network

LongVu219 avatar Nov 01 '24 04:11 LongVu219