Deep-Image-Matting icon indicating copy to clipboard operation
Deep-Image-Matting copied to clipboard

May I ask which dataset are you training on?

Open protossw512 opened this issue 6 years ago • 52 comments

Thank you for providing pretrained model. I have a question regarding to the trainnig dataset. Did you trained on the dataset from original paper or something else?

I tried to do testing on doll.png and troll.png from http://www.alphamatting.com dataset and got pretty bad results, not sure what happened.

I modified test.py code so that I am directly using trimap provided by the dataset, instead of generating trimap from alpha channel.

The segmentation seems to be heavily based on white area on alpha channel.

Here is my result of troll.png: image

I am new to image matting, not sure where I did wrong, do we need to do some preprocessing?

protossw512 avatar Oct 02 '17 21:10 protossw512

@protossw512 I trained on company's dataset which can be partially seen in test_data folder, it's relatively simple. Dataset mentioned in paper is more complex so the model training on it can generalize very well. Unfortunately, I tried to train on dataset mentioned in paper, but it's really really hard to converge. I'll try to improve the performance on it in future. Thank you for your great comments!

Joker316701882 avatar Oct 03 '17 00:10 Joker316701882

@Joker316701882 Thanks for reply, since I am working on university research project, I think I could get the dataset from author. I will update if I could get a better model.

protossw512 avatar Oct 03 '17 00:10 protossw512

@protossw512 Looking forward to your result! Let me know if you make it!

Joker316701882 avatar Oct 03 '17 00:10 Joker316701882

@protossw512 If you have any progress send us an update.

bhack avatar Oct 05 '17 10:10 bhack

In the paper, the authors mentioned this: "We find images on simple or plain backgrounds (Fig. 2a), including the 27 training images from [25] and every fifth frame from the videos from [26]"

Do you know how to get that video from [26]? I glanced over that paper but don't know which video to use. "[26] E. Shahrian, B. Price, S. Cohen, and D. Rajan. Temporally coherent and spatially accurate video matting. In Proceedings of Eurographics, 2012. 3"

hieudt-pixelz avatar Nov 02 '17 11:11 hieudt-pixelz

@protossw512 if you have had a progress, may you share the trained-model with us ?

Ru-Xiang avatar Nov 30 '17 04:11 Ru-Xiang

Yeah, I actually slightly modified loss function and data loading part, fixed some issue with original code that may lead to not good results, and also added refinement stage, getting some promising results, but I am not sure if I am allowed to release pretrained model, since I am training on Adobe dataset and I was not supposed to share it without permission of author. I haven't got time to refactor my code and post it on github yet. The model itself is not very hard to train, barely need to tune any parameters.

protossw512 avatar Nov 30 '17 04:11 protossw512

Thank you for your reply, it will be very appreciated if you share your codes at your convenience.

Ru-Xiang avatar Nov 30 '17 06:11 Ru-Xiang

Yeah, I think I am going to do that during winter break

protossw512 avatar Nov 30 '17 06:11 protossw512

@protossw512 Hi, can you tell me how to fix the code in detail except for refinement? Specially, what's the problem about loss function and network architecture?

Devin147 avatar Dec 12 '17 11:12 Devin147

@protossw512 Glad to here that you achieved promising results! Can you email me your email address? If it's possible, I would like to discuss about what refinement you have made to achieve good results. Thank : )

Joker316701882 avatar Feb 05 '18 04:02 Joker316701882

@Joker316701882 @ChengJunqi @Ru-Xiang Yeah, sure, please email me: helloxinyao.wang###gmail.com I think one fatal mistake for your original code is the creation of trimap from alpha, you have to perfom eroding and dilation alpha, but you only applied dilation, that's why the network is basically remember the boundaries of your trimap where pixel values are equal to 255.

There should be other minor issues, I cant remember them tho. I would like to rewrite your code but I do not have any more time to do so, but I can clean them a little bit and upload to my github

protossw512 avatar Feb 09 '18 00:02 protossw512

@protossw512 Did you manage to get a better model?

ricshaw avatar Mar 07 '18 17:03 ricshaw

@protossw512 Could you share the improvement in your github?

foamliu avatar Apr 20 '18 14:04 foamliu

Hello, if you can't have the dataset from Adobe, check on pixabay.com. There is a large amount of quite large pictures with transparency and good alpha. For instance, try this search : https://pixabay.com/fr/photos/?min_width=640&min_height=640&colors=transparent&image_type=photo&order=latest

The only issue is that you have to download the images by hand, but with a good methodology you can obtain 300 foreground image in a couple of hour.

Combined with the backgrounds described in the DIM publications, you can obtain encouraging results without any change to the network.

elzeru avatar May 21 '18 13:05 elzeru

@protossw512 Can you send me the Adobe datasets, I have send a email for author of Deep Image Matting, but I didn't get a reply.Thanks

shliang0603 avatar Oct 18 '18 02:10 shliang0603

@protossw512,Can you send me the Adobe datasets, I have send a email for author of Deep Image Matting, but I didn't get a reply.Thanks. My email is [email protected].

18191171661 avatar Dec 28 '18 12:12 18191171661

@protossw512 I know you may not be able to share your trained model as you explained authorization problem, but would you please share Joker's pretrained model? the link of his pretrained is missing ...... I'll appreciate much if you could do me this favor, thanks. my email: [email protected]

tsing90 avatar Jan 27 '19 15:01 tsing90

@protossw512,Can you send me the Adobe datasets, I have send a email for author of Deep Image Matting, but I didn't get a reply.Thanks. My email is [email protected].

have you got the dataset? thanks!

dailenson avatar Feb 28 '19 02:02 dailenson

@protossw512 Can you send me the Adobe datasets, I have send a email for author of Deep Image Matting, but I didn't get a reply.Thanks. My email is [email protected].

jayhhl avatar Feb 28 '19 08:02 jayhhl

Yeah, I think I am going to do that during winter break

Can you send me the Adobe datasets.Thanks!My email is [email protected]

ZhangChaoZhong avatar Jun 12 '19 07:06 ZhangChaoZhong

can you please send me the Adobe dataset. The author is not answering emails. Thanks in advance. [email protected]

ofrimasad avatar Jun 19 '19 11:06 ofrimasad

Could you send me the Adobe datasets? Thanks! My email is [email protected]

dudumeng avatar Aug 15 '19 06:08 dudumeng

@protossw512 Can you send me the Adobe datasets? Thanks! My email is [email protected] I'm a CS Student and I need it for MSc thesis

linpengzhang avatar Sep 02 '19 13:09 linpengzhang

Could you send me the datasets? I'm doing some related researches. Thanks!

My email is [email protected]

sinfere avatar Sep 22 '19 04:09 sinfere

@protossw512

Could you share the Adobe datasets, thank you! my email is haoran.andy###gmail.com

flyfish01 avatar Oct 21 '19 08:10 flyfish01

@protossw512 Could you send me the datasets? I'm doing some related researches. Thanks! My email is [email protected]

parachute0001 avatar Oct 22 '19 01:10 parachute0001

已经好久不研究这方面的技术了

------------------ 原始邮件 ------------------ 发件人: "parachute0001"[email protected]; 发送时间: 2019年10月22日(星期二) 上午9:58 收件人: "Joker316701882/Deep-Image-Matting"[email protected]; 抄送: "Subscribed"[email protected]; 主题: Re: [Joker316701882/Deep-Image-Matting] May I ask which dataset areyou training on? (#8)

@protossw512 Could you send me the datasets? I'm doing some related researches. Thanks! My email is [email protected]

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub, or unsubscribe.

tengda100 avatar Oct 22 '19 02:10 tengda100

Thank you for providing pretrained model. I have a question regarding to the trainnig dataset. Did you trained on the dataset from original paper or something else?

I tried to do testing on doll.png and troll.png from http://www.alphamatting.com dataset and got pretty bad results, not sure what happened.

I modified test.py code so that I am directly using trimap provided by the dataset, instead of generating trimap from alpha channel.

The segmentation seems to be heavily based on white area on alpha channel.

Here is my result of troll.png: image

I am new to image matting, not sure where I did wrong, do we need to do some preprocessing?

Could you share the Adobe datasets, thank you very much! My email is [email protected]

confident-OH avatar Oct 27 '19 02:10 confident-OH

@protossw512 Can you send me the Adobe datasets, I have send a email for author of Deep Image Matting, but I didn't get a reply.Thanks

Could you share the Adobe datasets, thank you very much! My email is [email protected]

confident-OH avatar Oct 27 '19 02:10 confident-OH