OpenHands icon indicating copy to clipboard operation
OpenHands copied to clipboard

Published 20 hours ago • verified publisher icon All-Hands-AI

Update download_test_data.py

Open moresearch opened this issue 10 months ago • 1 comments

I think princeton-nlp/SWE-bench_Lite_oracle is more suitable for MVP.

Source: https://www.swebench.com/lite.html

moresearch avatar Mar 27 '24 14:03 moresearch

The evaluation is currently progressing offline, so it's impossible to determine what it should be here for now, feel free to discuss it with us in slack's evaluation channel!

huybery avatar Mar 27 '24 20:03 huybery

Agree lite is probably better, but since we're still discussing I'm gonna close this to clean up a bit

rbren avatar Mar 29 '24 19:03 rbren