[Feature Request] Task Agent Planning Improvements: Environment Awareness, Tool Selection, and Replanning Strategy

[Pakchoioioi]

Motivation

1. When the agent lacks environmental understanding during initial task planning, the plan is likely to be wrong.
2. We need to clarify: when should the agent execute first and then re-plan, and when should it gather more information before planning?

Solution

@Wendong-Fan

1. Provide the task agent with a terminal and a browser. When facing a directed but unfamiliar environment, it should first browse or gather environmental information before making a task plan.

2. Set up four tools for the task agent:

• Directly respond (when the task is relatively simple).
• Go directly into workforce planning (when the task is complex and the environment is unfamiliar but not directed).
• Obtain environmental information first, then enter workforce planning (when the task is complex and the environment is unfamiliar but directed).
• The task agent chooses which tool to invoke based on the current task.

3. When a task goes directly into workforce planning, a fault-tolerance and retry mechanism needs to be designed. That is, when the agent makes mistakes but obtains more useful information, it should be able to re-plan the task.

Alternatives

No response

Additional context

No response