Ben Rombaut

Dependabot requires at least 5 candidate updates for a valid compatibility score badge to be shown (at least that was the case back in the summer of 2021 - see...

This same issue is also referenced in #73

0c58da1f24efc1477a7b2efe683f5dd8cf998419 is the commit that starts causing this error, if I go back to the previous commit (aa19fc126159a79e8471c3b3ad352b07fbf0bc49), I'm able to successfully run the evaluation script (albeit still with some...

@john-b-yang I also just reran with the updates pulled and a fresh env setup, still seeing the same issue

The addition of `conda install -n myenv conda` might be worth checking if it resolves the issue, see here https://conda.discourse.group/t/solved-modulenotfounderror-no-module-named-conda-when-running-conda-commands-within-environment/344/2 I don't have the time to test it out right...

So the test that should go from fail to pass is ```json "FAIL_TO_PASS": [ "test_sqlmigrate_for_non_transactional_databases (migrations.test_commands.MigrateTests)" ], ``` You can see the 2 lines in the log file: ``` test_sqlmigrate_for_non_transactional_databases...

#74 might be related to this issue

I found another case that's leading to false negative resolved status with Django, basically, the test it name is removed from test module/name path in the `tasks_for_evaluation.json` file (which was...

I've narrowed this down to this having to do with the Django version of the task instance. I'm using the SWE-Bench Lite dataset, and when I run the evaluation/metrics pipeline...

@john-b-yang With these new changes, I'm still kind of blocked until #77 gets resolved, I havnt found a workaround for that one that doesn't involve going back SWE-Bench versions