crab icon indicating copy to clipboard operation
crab copied to clipboard

[Feature Request] Add CLI use interface to manage environments, benchmarks and agents

Open dandansamax opened this issue 5 months ago • 0 comments

Required prerequisites

  • [X] I have searched the Issue Tracker that this hasn't already been reported. (+1 or comment there if it has.)

Motivation

Currently it's impossible for user to check detailed information of benchmarks, tasks, environments, etc. and interact with them dynamically.

Solution

We should design an CLI interface for user to manage these components. Several requirements as following:

Environments

  • Check information of current launching environments and their availibility, remote address, supported actions.
  • (Optional) Directly interact with the environment by CLI (receive observations, send actions).

Agents

  • List all available agent policies.
  • Choose a policy as current loaded policy

Benchmarks

  • Check current loading benchmarks, including envrionments, tasks and their IDs.

Tasks

  • Use task ID to check task description and other important informations.
  • Start a task from CLI with current loaded agent policy.

If you want other features, please comment below.

Additional context

No response

dandansamax avatar Aug 29 '24 10:08 dandansamax