OmniDrones icon indicating copy to clipboard operation
OmniDrones copied to clipboard

Feedback Welcomed!

Open btx0424 opened this issue 1 year ago • 4 comments

Hello everyone! We hope OmniDrones has provided you with a helpful starting point for conducting RL projects on UAVs.

We understand there could be trouble reading and customizing the codebase without familiarity with Isaac Sim. We would like to learn about your experiences and suggestions regarding the design and functionality of the project. For example, is the code structure too complicated to understand? What other features you are expecting?

I am also glad to engage in discussions and provide support for specific projects you would like to conduct with OmniDrones or Isaac Sim.

Feel free to raise issues!

btx0424 avatar Mar 06 '24 10:03 btx0424

Hello, I do appreciate your effort on this project and I believe this simulator is full of potential.

I have two wishes:

  1. Specific introduction and tutorials on the use of RGB-D camera
  2. Specific introduction and tutorials on the use of multi-agent system

I have checked some brief explanation and introduction of those in your document, but I could not clearly understand how. I may be lack of skill since I am new to both isaac sim and omnidrones, but I would be thankful if you could make tutorials on those two.

Thank you so much for your effort and helps.

jinwoolee1230 avatar Mar 06 '24 11:03 jinwoolee1230

Hello, thank you for your efforts on this project.

As @jinwoolee1230 said, it would be nice to have a specific introduction and tutorial on using the multi-agent system.

  • Parallelization for multi-agent

Thank you very much for your efforts and help.

mychoi97 avatar Mar 11 '24 12:03 mychoi97

Hello, we use Crazyflies and motion capture system now. I know that in several tasks, we can get (relative) position from observation. Is it feasible to explicitly add motion capture into the simulation platform? Thanks!

magixn avatar Mar 14 '24 09:03 magixn

I will use this library in the coming 8 months full-time for my thesis on autonomous drone racing. The goal of which will be to fly through a sequence of gates at high speeds using only onboard sensing and a stereo depth camera. For this I would love to collaborate on implementing the following features:

  • TDMPC2 (currently working on adapting the current tdmpc to its second version)
  • More custom track layouts. The Track task currently only draws lemniscates, but it would be nice to parameterize more complex shapes or even sparse waypoints
  • Integrating the Stereolabs motion tracker (combining IMU and camera images for VIO): https://github.com/stereolabs/zed-isaac-sim
  • Exporting the gates and environments from for example Flightmare to Omnidrones (seems to be quite easy to export unity files to USD)

ErinTUDelft avatar Apr 10 '24 09:04 ErinTUDelft