UR5LegoVision icon indicating copy to clipboard operation
UR5LegoVision copied to clipboard

Vision-Based Lego Detection, Localization, and Assembly Using UR5 Robot Arm

Results 32 UR5LegoVision issues
Sort by recently updated
recently updated
newest added

### 1. **Data collection and annotation**: The first step in object detection is to collect a dataset of images containing blocks in various poses and lighting conditions. Use Blender to...

vision
dataset
model training

## Steps for Simple Image-Based Analysis: #### 1. Preprocessing: - Obtain a clear outline image of the Lego castle with distinct shapes representing each block level. Ensure the outline is...

Approaching 2D flat construct first. This means given an input image of a castle from just a front view, calculate from each level (bottom to top) which lego blocks can...

FSM
object detection

Developing a lightweight software tool to define and assemble Lego constructions can be incredibly beneficial. This software could serve as a user-friendly interface for constructing and exporting Lego shapes. Here...

https://github.com/pytransitions/transitions A possible FSM could include the following states and transitions: **Initial state**: This is the starting state of the FSM. It could transition to the following states: - **Object...

motion planning
FSM

Kinematics in a robot project refers to the study of the motion of robots without considering the forces or torques that cause the motion. It focuses on describing and understanding...

documentation
kinematics

![Image](https://github.com/anhtuduong/UR5BlokVision/assets/76017474/e3b3ef01-0aa7-47c8-8f6a-730be459bc0b)

FSM
object detection
object localization

## Install environment Follow instructions in [locosim](https://github.com/anhtuduong/locosim) (recommend using [Docker](https://github.com/anhtuduong/locosim#usage-with-docker)) for [Window](https://github.com/mfocchi/lab-docker/blob/master/install_docker_windows.md) ## Start developing ### Clone the UR5BlokVision repo: ```bash cd ros_ws/src/ ```bash git clone [email protected]:anhtuduong/UR5BlokVision.git ``` ### Compile/Install...

documentation
enhancement

When stacking lego on top of each other, they break apart. One way to solve is to update **static** value of the lego in runtime.

bug
enhancement

We need an ACK system that signal **ready flag** between action to ensure every command is executed before firing next command.