embodied-agents
embodied-agents copied to clipboard
mbodiai
Seamlessly integrate state-of-the-art transformer models into robotics stacks
Was taking a look at the OpenVLA baseline in colab but it seems the final video is a failure. For some context I'm in the middle of porting the simpler...
# DinoV2 with registers backbone, transformer decoder, classifier free guidance film layers training script ☘️ Shoot an email to [email protected] if you'd like to tackle this issue and I'll help...
Create a new subclass of [SensoryAgent](https://github.com/MbodiAI/mbodied-agents/blob/b53ffa5f735daf69cda33caeb67de831bdb1ad46/src/mbodied_agents/agents/sense/sensory_agent.py) that returns a [Sample](https://github.com/MbodiAI/mbodied-agents/blob/b53ffa5f735daf69cda33caeb67de831bdb1ad46/src/mbodied_agents/base/sample.py) subclass representing the objects and volume bounding boxes. Steps: - [ ] 1. Experiment with pre-trained models in [Open3D-ML](https://github.com/isl-org/Open3D-ML?tab=readme-ov-file#model-zoo) -...
### Description Object Pose Detection Methodology Review ### Methods to be Tested - [ ] #28 - Requires: Aruco marker, RGBD map, camera intrinsics matrix. - Follow-on work: RANSAC plane...
