CURE icon indicating copy to clipboard operation
CURE copied to clipboard

Patch Validation and Reproduce result from the paper

Open faysalhossain2007 opened this issue 2 years ago • 4 comments

Thanks for building the great tool and sharing the code with the community!

It would be very helpful if you can upload the test cases from /tmp/validate_quixbugs/' and /tmp/validate_defect4j/.

Also I used your trained model to generate the patches with 100 beam size. It was not able to generate any correct patches or plausible patches. Also, I checked the validated_patches.json.json. But it also dont contain any patches with "plausible" tag.

I also checked out your validate_XX.py files. None of those contain any logic to detect correct patch. Are those updated files? Or am I missing something?

Can you please let me know how to reproduce the result from your paper on Defects4j dataset?

Thanks!

faysalhossain2007 avatar Sep 01 '22 07:09 faysalhossain2007

The test cases from /tmp/validate_quixbugs/' and /tmp/validate_defect4j/ are folders of defects4j and quixbugs repo. To reproduce the result, you need to clone these repos and configure the path.

Elena6918 avatar Jan 12 '23 16:01 Elena6918

When i use validate_defects4j.py to valid d4j reranked patches, it occured FileNotFoundError: [Errno 2] No such file or directory: '/home/lqy/MyProject/NPR_tools4data_leakage/new_test/nprtools/cure/candidate_patches/trans_D4J/tmpsource/org/jfree/chart/renderer/category/AbstractCategoryItemRenderer.java' error. Am I miss something? I try to clone the repo of d4j to /tmp/validate_defect4j/ but nothing use.

HanJin996 avatar May 21 '23 07:05 HanJin996

The error is a mistake which I make a wrong dir with "/home/lqy/MyProject/NPR_tools4data_leakage/new_test/nprtools/cure/candidate_patches/trans_D4J/tmp" missing a '/' at the end of the dir. But the model was unable to generated any correct patches or plausible patches (with 1000 beam size). I wonder if the identifier.txt and identifier.token were wrong? Because when gengrate the d4j_bpe.txt the "if(dataset == null)" will be "if dataset == null )", but "(" is in identifier.txt and identifier.token... I don't know why

HanJin996 avatar May 22 '23 10:05 HanJin996

The test cases from /tmp/validate_quixbugs/' and /tmp/validate_defect4j/ are folders of defects4j and quixbugs repo. To reproduce the result, you need to clone these repos and configure the path.

hello, can you explain more? I clone and installed defects4j in the cloned directory I have this files: cpanfile framework license.txt project_repos Dockerfile init.sh major README.md I have to use path of this folder instead of /tmp/validate_defect4j/ ? regards,

SajedeNick1999 avatar Jun 20 '23 09:06 SajedeNick1999