Ryan H. Tran

Support MINT benchmark (MATH, GSM8K subset)

1

This PR provides a draft evaluation integration for the MINT benchmark which tests the agent's ability to solve tasks with multi-turn interactions. This benchmark tests the agent's ability of code...

Enhance code agent's search ability with ACR's context search API

10

**What problem or use case are you trying to solve?** The current search skills available to the agent is: ```python - search_dir(search_term, dir_path='./'): # Searches for a term in all...

feat(workflow): Implement a simplified CoAct workflow

29

**Short description of the problem this fixes or functionality that this introduces. This may be used for the CHANGELOG** - This PR implements a simplified multi-agent workflow inspired by the...

[Bug]: (eval) Command execution error when retrying after rate limit error

2

### Is there an existing issue for the same bug? - [X] I have checked the troubleshooting document at https://docs.all-hands.dev/modules/usage/troubleshooting - [X] I have checked the existing issues. ### Describe...

[Bug]: (eval) Instance results with llm proxy `OpenAIException` errors got merged into output.jsonl

5

### Is there an existing issue for the same bug? - [X] I have checked the troubleshooting document at https://docs.all-hands.dev/modules/usage/troubleshooting - [X] I have checked the existing issues. ### Describe...

[Experimental] Integrate repomap

3

**End-user friendly description of the problem this fixes or functionality that this introduces** - [ ] Include this change in the Release Notes. If checked, you must provide an **end-user...

**End-user friendly description of the problem this fixes or functionality that this introduces** - [ ] Include this change in the Release Notes. If checked, you must provide an **end-user...

[Experiment] Add symbol navigation commands into the editor

10

**End-user friendly description of the problem this fixes or functionality that this introduces** - [ ] Include this change in the Release Notes. If checked, you must provide an **end-user...

**End-user friendly description of the problem this fixes or functionality that this introduces** - [ ] Include this change in the Release Notes. If checked, you must provide an **end-user...

Upgrade `openhands-aci` to v0.1.2

3

**End-user friendly description of the problem this fixes or functionality that this introduces** - [ ] Include this change in the Release Notes. If checked, you must provide an **end-user...