Gourieff
[Feature]: Use ReActor Face Model Safetensors as input for other nodes.
Feature description
IT would be nice if your models could be used for inputs for InstantID, IPAdaptors and other nodes that require an input. I am aware for this to even be possible a image would have to be generated.
The purpose is to have that matching bone structure. That would be a dream come true if it could be used this way instead of having an image beforehand that way the models could be used in latentspace during rendering.
Thank you.
Gourieff I have made a bootleg version of this that can work see example
If there was a way to have cultural presets like this and have reactor swap on to them then you can use this node with ipadapters, instantid and so on. Turning your node into a lora of sorts. I hope I was more clear now.
in continuation of https://github.com/Gourieff/comfyui-reactor-node/issues/326#issuecomment-2201046641
Yes. I sent an example that works but the down side is the skin tone must always change for the person you are swapping. The image would have to change to the person's complexion. And after studying ipadapters by Matte0 I see that the face should be in the same pose but slightly different.. It may seem complicated but not so much from the practical side of it. (Coding I do not know). If you have a setting for different bone structures%20races%20was%20wrong.) ...
I think I got it this time :) This feature can be implemented but the main issue of this method is the correct morphology of the head and face If ReActor swaps the face we need to the prearranged set of different-angles images (universal female's and male's heads) - there will be a wrong morphology every time we prepare this set to send it to the IP-Adapter and it will produce not a very accurate result The best bone structure is achieved when we use IPAdapter (or even 2 IPAdapters: FaceID and fullface) to produce the image with the face very morphologically close to the original and then swap the face in the image with ReActor The other way is to make a node that will convert ReActor's models to the IPAdapter's format on the fly 🤔
The other way is to make a node that will convert ReActor's models to the IPAdapter's format on the fly 🤔
This is the best way. the methods I was talking about was to produce things before the fact (FaceID/Fullface). Some way to make the safetensors act like a lora.
I think this injected into the swap will fix the issue I was trying to fix. https://github.com/fssorc/ComfyUI_FaceShaper/blob/main/screenshot.png
This match two faces' shape before using other face swap nodes. If one has a saved model it would have to be implemented into your nodes so it does this before the swap.