Gymnasium icon indicating copy to clipboard operation
Gymnasium copied to clipboard

[Proposal] Add Tutorials for MuJoCo based environments (contributors welcome)

Open Kallinteris-Andreas opened this issue 2 years ago • 5 comments

Proposal

With the release of the MuJoCo-v5 environments, in Gymnasium 1.0.0 (which will be coming out, prior to the heat death of the universe).

We need tutorials on:

  • [x] loading a quadruped custom robot model (WIP https://github.com/Farama-Foundation/Gymnasium/pull/838)
  • [ ] loading a bipedal / humanoid custom robot model
  • [ ] loading a custom scene e.g. G-Barkour (which will have custom reward, obs?, terminal?)
  • [ ] Using robot model with custom simulation options
  • [ ] Create a Custom MuJoCo based environment class by subclassing MujocoEnv
  • [ ] ??? Transfer learning across different models ???
  • [ ] Transfer learning with MuJoCo MPC
  • [ ] more tutorials ???

Contributors are welcome, with experience running RL on robotic environments, or with knowledge of the MuJoCo simulator, or with knowledge of Robotics, or just willingness to learn. Comment here or discuss or join the gymnasium discord (invite link on the README) and ping me in the # New Contributors channel.

Motivation

No response

Pitch

No response

Alternatives

No response

Additional context

No response

Checklist

  • [X] I have checked that there is no similar issue in the repo

Kallinteris-Andreas avatar Dec 16 '23 20:12 Kallinteris-Andreas

@Kallinteris-Andreas Is anyone working on Create a Custom MuJoCo based environment class by subclassing MujocoEnv? If not, I am working on just the right thing for this currently.

tldr; I am creating a MuJoCo version of X-MAGICAL, which is originally created with a 2D simulator and shown below:

shortstick-sweep

So far, my environment looks like this:

https://github.com/Farama-Foundation/Gymnasium/assets/50164418/b44ab71f-a0a7-4d41-bde3-9b6ed52d73ef

I'm integrating Gymnasium API support for the environment, and i'm doing this by subclassing MujocoEnv.

Let me know your thoughts, i'm happy to contribute this : )

jonzamora avatar May 11 '24 04:05 jonzamora

@jonzamora feel free to submit a PR with your tutorial

(sorry for late reply, i though i had reply)

Kallinteris-Andreas avatar Jul 08 '24 11:07 Kallinteris-Andreas