Genesis icon indicating copy to clipboard operation
Genesis copied to clipboard
verified publisher icon Genesis-Embodied-AI

[FEATURE] Heterogeneous Simulation

Open YilingQiao opened this issue 4 months ago • 7 comments

Description

This PR enables the rigid solver to simulate different objects in different environments. In other words, an entity can have different morphs in different environments.

Currently, it only supports primitive and mesh morphs, and only the Pyrender rasterizer supports this feature. We plan to support variable articulation and additional rendering backends in the future.

Try

python examples/rigid/heterogeneous_simulation.py -v

https://github.com/user-attachments/assets/f862d51e-b3f7-4f5b-8b2f-9e900542c8be

Related Issue

Resolves Genesis-Embodied-AI/Genesis#1449 Resolves Genesis-Embodied-AI/Genesis/issues/333

Motivation and Context

How Has This Been / Can This Be Tested?

Screenshots (if appropriate):

Checklist:

  • [x] I read the CONTRIBUTING document.
  • [x] I followed the Submitting Code Changes section of CONTRIBUTING document.
  • [x] I tagged the title correctly (including BUG FIX/FEATURE/MISC/BREAKING)
  • [x] I updated the documentation accordingly or no change is needed.
  • [x] I tested my changes and added instructions on how to test it for reviewers.
  • [ ] I have added tests to cover my changes.
  • [ ] All new and existing tests passed.

YilingQiao avatar Aug 18 '25 06:08 YilingQiao

@YilingQiao Few questions regarding this new feature:

  1. Is the value obtained by grasping_object.get_mass() form the first element in batch?
  2. grasping_object.get_AABB() seems to return the same value regardless of the actual geom in batch. Is this expected?

Kashu7100 avatar Aug 19 '25 04:08 Kashu7100

@Kashu7100 get_AABB() and ge_mass() are fixed.

YilingQiao avatar Aug 20 '25 02:08 YilingQiao

@YilingQiao will this be merged sometime sooner?

Kashu7100 avatar Oct 06 '25 03:10 Kashu7100

It will be merged after @SonSang differentiation PRs

YilingQiao avatar Oct 06 '25 14:10 YilingQiao

Ok thanks!!

Kashu7100 avatar Oct 06 '25 16:10 Kashu7100

Hello everyone. Can I ask what is the status of this PR and if it is going to be merged?

stergiosba avatar Oct 24 '25 16:10 stergiosba

@stergiosba We will merge this PR after #1808 (which has some code structure change will impact the implementation of this feature) is merged. Hopefully in ~2 weeks.

YilingQiao avatar Oct 24 '25 17:10 YilingQiao

hello, since #1808 has been merged, I was just wondering if we can expect an eta on this PR? thanks!

SamratSahoo avatar Dec 02 '25 01:12 SamratSahoo

This look super exciting and useful! Just wondering how things are progressing.

Satvik1701 avatar Dec 09 '25 00:12 Satvik1701