ml-agents icon indicating copy to clipboard operation
ml-agents copied to clipboard

feat(project): Initialize UR16e pick and place project

Open henry2craftman opened this issue 1 month ago • 1 comments

Proposed change(s)

Description

This PR establishes the initial framework for the UR16e Pick and Place project within the ML-Agents repository. It introduces the core components required to train a UR16e robotic arm for a
pick-and-place task using reinforcement learning.

Key Changes

  • 🤖 Agent Implementation (UR16Agent.cs): A new agent script has been added to manage the robot's learning process. It defines
    the state observations, action space, and reward function
    tailored for the pick-and-place task.
  • 🛠️ Unity Environment (UR16 agents.unity): A dedicated Unity scene is included, featuring the UR16e robot, the target object, and the necessary ML-Agents components for training and
    inference.
  • 📚 Documentation (README.md, README.ko.md): Comprehensive
    documentation has been added in both English and Korean. The
    READMEs explain the project's purpose, structure, and provide
    clear instructions on how to get started and run the simulation.

Purpose

The goal of this PR is to formally initialize the project and provide a solid foundation for future development and experimentation with the UR16e robot. By adding the core logic and documentation upfront, it makes the project accessible and understandable for other contributors.

How to Test

  1. Clone the branch.
  2. Open the project in Unity Editor (version 6000.0.42f1 or
    compatible).
  3. Open the Assets/UR16 agents.unity scene.
  4. Enter Play mode to run the simulation.
  5. Verify that the agent and environment are loaded correctly and the simulation runs without errors.
  6. (Optional) Review the code in UR16Agent.cs and the content of the new README files.

Vidoes ML-Agent UR16 PPO 1 ML-Agent UR16 PPO 2 ML-Agent UR16 PPO 3 ML-Agent UR16 PPO 4 ML-Agent UR16 PPO 5

Useful links (Github issues, JIRA tickets, ML-Agents forum threads etc.)

Types of change(s)

  • [ ] Bug fix
  • [ ] New feature
  • [ ] Code refactor
  • [ ] Breaking change
  • [x] Documentation update
  • [x] Other (please describe)

Checklist

  • [x] Added tests that prove my fix is effective or that my feature works
  • [x] Updated the changelog (if applicable)
  • [x] Updated the documentation (if applicable)
  • [x] Updated the migration guide (if applicable)

Other comments

henry2craftman avatar Nov 10 '25 06:11 henry2craftman

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
You have signed the CLA already but the status is still pending? Let us recheck it.

CLAassistant avatar Nov 10 '25 06:11 CLAassistant