Anmol Agarwal

Results 7 comments of Anmol Agarwal

@burak0006 @LawlAoux You can make use of the less complicated version of the parsed string at the leaf to solve this issue. ```python all_tokens = self.span_obj._.parse_string.split("(") label = all_tokens[1].split(" ")[0]...

@davidhalter Regarding what @mithaler mentions [here](https://github.com/davidhalter/jedi/issues/1888#issuecomment-1966904165) ie ` I can say that this only happens when we delve deeply into the dependency tree, and it happens unpredictably (that is, I...

This seems to happen for me as well for several test cases such as `'psf__requests-1724'`

@john-b-yang Thanks for your response. I was actually talking about `FAIL_TO_PASS` and `PASS_TO_PASS` test cases only. Turns out that there are some logs which get rendered as: ![image](https://github.com/princeton-nlp/SWE-bench/assets/54059763/5724d90d-778d-4470-96a8-8ad1d63f759a) which in...

@john-b-yang Additionally, there are certain cases where the FAIL_TO_PASS testcases have the format: _"function name"(absolute path)_. Eg: **test_cal[/home/anmol/swebench/exp/1]** and since this absolute path may vary across different machines, even the...

@ChiYeungLaw @nlpxucan I am trying to run **batch inference** by making the small change on this [line](https://github.com/nlpxucan/WizardLM/blob/46d1ce7dbbb1f987ae5e5915c75f33b89a6a17ab/WizardCoder/src/humaneval_gen.py#L130). However, since different inputs may not be of the same size, there needs...

> Have you tried more samples? I did try this for different prompts (including non-coding based instructions).