InstructDiffusion icon indicating copy to clipboard operation
InstructDiffusion copied to clipboard

Questions about the post-processing for keypoint detection and segmentation

Open essunny310 opened this issue 2 years ago • 2 comments

Hi, very interesting work!

As mentioned in the paper, a lightweight U-Net is leveraged to post-processes the output image to generate some heatmaps (for keypoint detection) or masks (for segmentation). Which specific model did you use? How did you train the U-Net? It would be helpful if you could provide more details about this.

Thank you.

essunny310 avatar Sep 12 '23 15:09 essunny310

Extracting keypoints or masks from the images generated by our editor is a simple mapping process, so the UNet will have minimal impact on performance.

Gengzigang avatar Sep 18 '23 09:09 Gengzigang

Thanks for your reply.

Could you please provide more details about this procedure? Thanks a lot.

essunny310 avatar Sep 19 '23 17:09 essunny310