[Feature]: Create a better leaderboard for OpenHands

[openhands-agent]

What problem or use case are you trying to solve? Currently, there is no comprehensive leaderboard that effectively tracks the performance of open-sourced models within OpenHands. A clear leaderboard would facilitate comparison and improvement.

Describe the UX of the solution you'd like An online sheet that continuously updates and tracks performance metrics for various models, possibly with the ability to click on links for deeper insights specific to each model.

Do you have thoughts on the technical implementation? The leaderboard could utilize existing performance data stored in a central database, automatically populated and refreshed at intervals, ensuring real-time updates.

Describe alternatives you've considered Using a static document or manual tracking methods, but these lack the dynamic features and timeliness that a real leaderboard would provide.

Additional context This initiative was discussed in a recent thread on Slack with users expressing interest in better tracking mechanisms for performance.

Issue Created By: Graham Neubig on Slack

[neubig]

Currently this doc is our best leaderboard: https://docs.google.com/spreadsheets/d/1wOUdFCMyY6Nt0AIqF705KN4JKOWgeI4wUGUP60krXXs/edit?gid=0#gid=0

[JohnsterID]

Probably separate feature request, linking in with the feedback method, could users run and submit a benchmark from their setup from the UI (not swe, maybe something simpler or lite)?

edit: disregard, just noticed https://github.com/All-Hands-AI/OpenHands/issues/5924

[github-actions[bot]]

This issue is stale because it has been open for 30 days with no activity. Remove stale label or comment or this will be closed in 7 days.

[github-actions[bot]]

This issue is stale because it has been open for 30 days with no activity. Remove stale label or comment or this will be closed in 7 days.

[github-actions[bot]]

This issue was closed because it has been stalled for over 30 days with no activity.