invariant_rationalization icon indicating copy to clipboard operation
invariant_rationalization copied to clipboard

beer review results

Open yes1234man opened this issue 5 years ago • 5 comments

Hi, thanks for sharing the codes. The main results of this paper are beer review results which is not shared, could you please assist me with sharing codes and data to reproduce these results. thank you for your collaboration.

yes1234man avatar Jul 12 '20 23:07 yes1234man

Please refer to the README for the instruction to obtain the data. The provided code should be sufficient for you to reproduce our results.

code-terminator avatar Jul 13 '20 13:07 code-terminator

Hi First of all, please do not close an error while this is not solved, this is unethical!! second, no this is not sufficient, before publication you argue you share your codes, afterwards you do not collaborate. How should we know if your results were really correct and not a fake one? In research community, everyone needs to share the code and data. Abh

On Mon, Jul 13, 2020 at 3:31 PM Shiyu Chang [email protected] wrote:

Please refer to the README for the instruction to obtain the data. The provided code should be sufficient for you to reproduce our results.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/code-terminator/invariant_rationalization/issues/2#issuecomment-657562396, or unsubscribe https://github.com/notifications/unsubscribe-auth/AODM7IZATKWR7Z7ULI5YX2LR3MED7ANCNFSM4OYA3KTA .

yes1234man avatar Jul 13 '20 13:07 yes1234man

We recently found that the beer review dataset has been removed by the original authors (https://snap.stanford.edu/data/web-BeerAdvocate.html). Due to this problem, we cannot publish the dataset at this point. You might consider contacting the original authors for a copy of the dataset. This is also unexpected to us. We could help to generate indices that match our partition once you have access to the original dataset.

code-terminator avatar Jul 13 '20 14:07 code-terminator

Hi Thanks for the explanations, but I cannot see why you could NOT share a copy of these datasets along with codes for the purpose of reproducibility of your results. You can simply share the processed datasets and ask people to cite the original paper. To me such not collaboration is a very bad sign. I really hope you share the copy of data and codes to 1) show your results are real 2) respect the the research community and your promises to release data and codes after publication.

I consider this as severe misconduct. Even simple preprocessing can impact the final results, how do you expect people to reproduce the results while you are not helping in sharing codes and data?

On Mon, Jul 13, 2020 at 4:48 PM Shiyu Chang [email protected] wrote:

We recently found that the beer review dataset has been removed by the original authors (https://snap.stanford.edu/data/web-BeerAdvocate.html). Due to this problem, we cannot publish the dataset at this point. You might consider contacting the original authors for a copy of the dataset. This is also unexpected to us. We could help to generate indices that match our partition once you have access to the original dataset.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/code-terminator/invariant_rationalization/issues/2#issuecomment-657605040, or unsubscribe https://github.com/notifications/unsubscribe-auth/AODM7IZRTR2LNL435HSFNALR3MNEDANCNFSM4OYA3KTA .

yes1234man avatar Jul 13 '20 14:07 yes1234man

Please refer to #6

Gorov avatar Jul 13 '20 20:07 Gorov