iSDF icon indicating copy to clipboard operation
iSDF copied to clipboard

iSDF integration with Franka + realsense

Open suddhu opened this issue 2 years ago • 0 comments

This runs similar to the live camera demo, but subscribes to Franka Panda inverse kinematics rather than ORB-SLAM. Additionally, this implementation has been tuned to work for tabletop scenes and is restricted to a defined workspace. I conducted tests live on the Franka Panda, and on the realsense_franka datasets from data/download_franka.sh. Also checked runs on the ReplicaCAD dataset and ORBSLAM live demo to ensure the changes did not break the main repo.

The easiest way to verify the implementation without access to a Franka is roslaunch isdf train_franka.launch live:=false inc:=true from the readme. If you have a Franka, you follow the readme instructions for running iSDF live.

Other smaller changes unrelated to the Franka:

  • data/download_apt_2_nav.sh failed to unzip correctly, fixed
  • removed hardcoded prefix from environment.yml
  • cam_scale parameters for Draw3D drawcams
  • Added grid_dim and extra_opt_steps as arguments in train.py
  • adaptive display_scenes to screenwidth in train.py
  • Disabled opacity for ReplicaCAD in trainer.py (it breaks due to undefined pc)

Happy to make any changes!

suddhu avatar Jul 28 '22 14:07 suddhu