ros_reality icon indicating copy to clipboard operation
ros_reality copied to clipboard

Baxter placement in Unity scene

Open agutif opened this issue 6 years ago • 4 comments

We are trying to control our Baxter robot with Oculus HMD and Oculus Touch controllers.

We installed successfully ros_reality_bridge (no_ein branch) in the Baxter workstation and our Kinect is correctly calibrated as you can see in this screenshot.

captura de pantalla de 2018-06-01 12_36_44

But in Windows computer, when we launch one scene, we saw the pointcloud of Baxter "emerging" from the ground, so we can not place ourselves as if we were Baxter.

captura de pantalla 1 captura de pantalla 2

We can open and close the grippers by pressing the triggers, but we can not control the arms, maybe because we can not be placed as if we were Baxter.

Thanks in advance for your help.

agutif avatar Jun 01 '18 11:06 agutif

Hi, May I please ask if it is doable with the simulated Baxter in the gazebo? Or I have to start with the real one? Thanks a lot.

stevensu1838 avatar Aug 08 '18 21:08 stevensu1838

At @stevensu1838, you can definitely do this with a simulated baxter.

at @agutif, it looks like the kinect transformation is not read being appropriately in unity. Does the robot itself appear?

dwhit avatar Aug 09 '18 15:08 dwhit

At @dwhit, no. In the Unity scene I can only see the point cloud generated by the Kinect and the cameras of the hands.

agutif avatar Aug 30 '18 11:08 agutif

@agutif Were you getting any errors in the Unity scene when running this? Can you also confirm that on the ROS side that your /ros_unity topic is streaming the TF data correctly?

ericrosenbrown avatar Nov 12 '18 20:11 ericrosenbrown