AttnGAN icon indicating copy to clipboard operation
AttnGAN copied to clipboard

Would you like to make the implementation of R-precision available?

Open ShihuaHuang95 opened this issue 5 years ago • 19 comments

Hi, I am going to compare AttnGAN with our method, I am wondering if you can release the code for the R-precision proposed in your AttnGAN paper and make the comparison more fairly.

ShihuaHuang95 avatar Apr 29 '19 03:04 ShihuaHuang95

What method are you using? Is it published?

gryBox avatar Apr 29 '19 04:04 gryBox

No, still in progress.

ShihuaHuang95 avatar Apr 29 '19 04:04 ShihuaHuang95

Quick question: From your understanding of this model. Does the quality of the images generated depend on the hyperparameter CAPTIONS_PER_IMAGE. For example does training a dataset with 5 captions per image vs 1 (long) caption per image make a difference?

FWIW: I've been working with @gar1t on using guild with this model. Makes it super easy to do hyperparamater optimization and keep track of tests.

gryBox avatar Apr 29 '19 21:04 gryBox

Emmm...., I have not taken such issue into account. But I think they would make a difference, as more captions will provide more meaningful samples for the training of the text encoder.

ShihuaHuang95 avatar Apr 30 '19 02:04 ShihuaHuang95

Thank you for your answer. It was what I was looking for. For context -- This is what I am currently working on. A data pipeline to automatically prepare training data for a text to image model.

Pycon 2019 Poster presentation (It's a 4ft x 8ft poster) Not to be viewed on a small screen.

PyCon2019-Image-DataPieline.pdf

gryBox avatar Apr 30 '19 15:04 gryBox

Cool! Excellent work!

ShihuaHuang95 avatar May 01 '19 06:05 ShihuaHuang95

Thank you. Again from your understanding of this model. Do the captions have to be fixed? For example: Can one image have 5 captions and another 20?

The whole point of this is minimize the amount of data the machine needs as inputs and do some automatic labeling.

Thanks again for taking the time to answer these questions.

gryBox avatar May 01 '19 13:05 gryBox

@Hshihua so have you implemented the R-precision?

venuszhou avatar Jun 02 '19 14:06 venuszhou

@venuszhou Not yet, but I am trying my best to re-implement.

ShihuaHuang95 avatar Jun 03 '19 06:06 ShihuaHuang95

@venuszhou @gryBox Hi guys, I have opened a new repo for such evaluation metrics, and I am going to finish this work in the next month.

ShihuaHuang95 avatar Jun 04 '19 03:06 ShihuaHuang95

@Hshihua - Nice. I am currently working on automating the process of running all the steps once data is downloaded. Early draft: https://github.com/gryBox/pytig/tree/photo. At pycon there was a strong interest by a number of senior people to contribute to a python library for text to image generation. The idea is take a few state of the art text to image models, maintain and optimize them for users looking to experiment with models in a couple commands

gryBox avatar Jun 04 '19 04:06 gryBox

I want to know how to evaluate whether a picture is related to a sentence

huqiyii avatar Jul 20 '19 02:07 huqiyii

@Hshihua Excuse me, do you implement the R-precision now? It's important. I think I need your help

Iceland-Leo avatar Jul 29 '19 10:07 Iceland-Leo

@Hshihua Excuse me, do you implement the R-precision now? It's important. I think I need your help

Excuse me,It’s also very important for me, have you solve this problem and willing to share it? Thank you very much!

FlowerRoad1996 avatar Sep 06 '19 08:09 FlowerRoad1996

I wrote an R-Precision module for AttnGAN. It measures the R-Precision of evaluated images from a certain checkpoint. The result may be off a bit from the paper because how the image is generated but should be consistent. Hope this can help. @Iceland-Leo @FlowerRoad1996

maincarry avatar Sep 09 '19 02:09 maincarry

I wrote an R-Precision module for AttnGAN. It measures the R-Precision of evaluated images from a certain checkpoint. The result may be off a bit from the paper because how the image is generated but should be consistent. Hope this can help. @Iceland-Leo @FlowerRoad1996

Oh,thank you very much! I'll try to use it, and I also want to evaluate it by myself and compare the result.

FlowerRoad1996 avatar Sep 09 '19 06:09 FlowerRoad1996

I wrote an R-Precision module for AttnGAN. It measures the R-Precision of evaluated images from a certain checkpoint. The result may be off a bit from the paper because how the image is generated but should be consistent. Hope this can help. @Iceland-Leo @FlowerRoad1996

Thank you very much! I'll use it.

Iceland-Leo avatar Sep 09 '19 06:09 Iceland-Leo

I wrote an R-Precision module for AttnGAN. It measures the R-Precision of evaluated images from a certain checkpoint. The result may be off a bit from the paper because how the image is generated but should be consistent. Hope this can help. @Iceland-Leo @FlowerRoad1996

Would you like to share the r-precision module, thanks very much

cripac-sjx avatar Sep 14 '20 02:09 cripac-sjx

I wrote an R-Precision module for AttnGAN. It measures the R-Precision of evaluated images from a certain checkpoint. The result may be off a bit from the paper because how the image is generated but should be consistent. Hope this can help. @Iceland-Leo @FlowerRoad1996

Could you please share the r-precision module with me? Thanks! My email address is [email protected].

cloverzyy avatar Oct 08 '20 08:10 cloverzyy