carlos

Another possible solution would be to have a `install_script` attribute in the config that takes a filename or raw string that is executed instead of `install_env` in the environment setup....

Hi! We've just uploaded them. You can download them [here](https://drive.google.com/drive/folders/1EnrKzGAnsb_NmZKyECGmA2DrAc8ZuJ80?usp=sharing). Let us know if you need anything else!

Ah, 472 was only generated due to length constraints. We sample 25% uniformly from 2294, but some of that is longer than gpt-4-32k-0613's context window. (See the gpt4-32k-0613__SWE-Bench_bm25_27K for all...

We're still reviewing the process for evaluating submissions. For now, we'd prefer results with a public or soon-to-be-public paper or technical report and the generated patches we can use to...