crab
crab copied to clipboard
[Feature Request] Add CLI use interface to manage environments, benchmarks and agents
Required prerequisites
- [X] I have searched the Issue Tracker that this hasn't already been reported. (+1 or comment there if it has.)
Motivation
Currently it's impossible for user to check detailed information of benchmarks, tasks, environments, etc. and interact with them dynamically.
Solution
We should design an CLI interface for user to manage these components. Several requirements as following:
Environments
- Check information of current launching environments and their availibility, remote address, supported actions.
- (Optional) Directly interact with the environment by CLI (receive observations, send actions).
Agents
- List all available agent policies.
- Choose a policy as current loaded policy
Benchmarks
- Check current loading benchmarks, including envrionments, tasks and their IDs.
Tasks
- Use task ID to check task description and other important informations.
- Start a task from CLI with current loaded agent policy.
If you want other features, please comment below.
Additional context
No response