openvino_notebooks icon indicating copy to clipboard operation
openvino_notebooks copied to clipboard

【PaddlePaddle Hackathon 4】No.205 Notebook RFC -Make the photo move

Open ziyuanji opened this issue 2 years ago • 14 comments

Solution Name Animation of generating smiling faces in photos Description Recently, there have been numerous AI applications emerging that are dazzling. Among them, the application of AI that makes old people "move" in old photos is particularly eye-catching, allowing the characters in old photos to perform any prescribed actions, helping people see photos of past loved ones from a new perspective~ And among them, the PaddleGAN model is used to transfer the expression of character A in the video to the face of character B in the picture, completing the expression "smiley face"~to achieve "old friend laughing"

Workflow 流程图

Models PaddleGAN

**Results Visualizing ** src tag

Project Timeline 3/31 Submitting RFC 4/10 Creating PR 4/30 Merging PR

ziyuanji avatar Mar 30 '23 10:03 ziyuanji

Hi @ziyuanji great thanks for your RFC, and it looks very interesting. Could you help to put more comments to explain more on the function or scenario of this use case ? My understanding is it can change the type of people's hair, am I right ? does it have any further features ? BTW, you should be very careful on using a sample picture of a real person, and we have to get permission before start with it.

openvino-dev-samples avatar Mar 31 '23 02:03 openvino-dev-samples

Also want to know more about this RFC. Is it only for changing hair style, or only on portrait? or can be extended to anything?

Features involving human face does raise a lot of concerns in AI ethics, especially for portraits of celebrities. Should be careful on this.

zhuo-yoyowz avatar Mar 31 '23 04:03 zhuo-yoyowz

hello everyone! Have you noticed that many hair changing software nowadays can only cover the original hairstyle with a layer of hair, either changing the face or body, without the function of cutting the hair short or shaving the head? In real life, many people want to cut their hair short or shave their hair, but they are afraid that the effect of cutting it will be ugly, but if their hair is cut short or trimmed, it will not be able to grow back for a while and a half, and their hearts are very troubled, How good is it that deep learning can help solve their problems

ziyuanji avatar Mar 31 '23 07:03 ziyuanji

Hi @ziyuanji Can you clarify more on whats the inputs and outputs in this workflow, Does the inputs include some text prompt ? or just a raw image.

openvino-dev-samples avatar Mar 31 '23 07:03 openvino-dev-samples

The input is the original image (with hair), and the output image (without hair) after entering the model processing

ziyuanji avatar Mar 31 '23 07:03 ziyuanji

The input is the original image (with hair), and the output image (without hair) after entering the model processing

------------------ 原始邮件 ------------------ 发件人: "openvinotoolkit/openvino_notebooks" @.>; 发送时间: 2023年3月31日(星期五) 中午12:54 @.>; @.@.>; 主题: Re: [openvinotoolkit/openvino_notebooks] RFC of PaddlePaddle Hackathon 4 Task 205 (Issue #967)

Also want to know more about this RFC. Is it only for changing hair style, or only on portrait? or can be extended to anything?

Features involving human face does raise a lot of concerns in AI ethics, especially for portraits of celebrities. Should be careful on this.

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you were mentioned.Message ID: @.***>

ziyuanji avatar Mar 31 '23 10:03 ziyuanji

hello everyone! Have you noticed that many hair changing software nowadays can only cover the original hairstyle with a layer of hair, either changing the face or body, without the function of cutting the hair short or shaving the head? In real life, many people want to cut their hair short or shave their hair, but they are afraid that the effect of cutting it will be ugly, but if their hair is cut short or trimmed, it will not be able to grow back for a while and a half, and their hearts are very troubled, How good is it that deep learning can help solve their problems

------------------ 原始邮件 ------------------ 发件人: "openvinotoolkit/openvino_notebooks" @.>; 发送时间: 2023年3月31日(星期五) 上午10:37 @.>; @.@.>; 主题: Re: [openvinotoolkit/openvino_notebooks] RFC of PaddlePaddle Hackathon 4 Task 205 (Issue #967)

Hi @ziyuanji great thanks for your RFC, and it looks very interesting. Could you help to put more comments to explain more on the function or scenario of this use case ? My understanding is it can change the type of people's hair, am I right ? does it have any further features ? BTW, you should be very careful on using a sample picture of a real person, and we have to get permission before start with it.

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you were mentioned.Message ID: @.***>

ziyuanji avatar Mar 31 '23 10:03 ziyuanji

Hello, OpenVINO dev content, zhuo yoyowz! How to improve RFC

ziyuanji avatar May 17 '23 06:05 ziyuanji

i dont think this topic is a typical and highly-demand use case for business, cuz it just remove the hair from your head. My suggestion is you can replace the topic of this RFC with a more common or interesting use case, for example generating an animation of smiling face from a photo.

openvino-dev-samples avatar May 17 '23 07:05 openvino-dev-samples

Ok, thank you OpenVINO dev content

ziyuanji avatar May 17 '23 07:05 ziyuanji

Hello OpenVINO dev content! Is this instance okay

ziyuanji avatar May 18 '23 04:05 ziyuanji

Hello @OpenVINO-dev-contest ! ! Is this instance okay

ziyuanji avatar May 18 '23 04:05 ziyuanji

Yes the result looks good to me, but you have to make sure these model can be deployed by openvino. BTW, since your code have to been merged by the end of May according to Paddle's rule, I dont think we have enough time to include it in Paddle Hackathon's result, but we still welcome to see your contribution

openvino-dev-samples avatar May 18 '23 06:05 openvino-dev-samples

Ok, openvino has good performance. I must convert the model to onnx format to facilitate openvino deployment

ziyuanji avatar May 18 '23 06:05 ziyuanji

This issue will be closed in a week because of 9 months of no activity.

github-actions[bot] avatar Jul 17 '24 00:07 github-actions[bot]