Blue Space

Hey guys, you can see my gist to detect adb port and set proxy: https://gist.github.com/ETOgaosion/e9c2752124b1795dbe2aa9430c2a7a40 ```cmd @echo off setlocal enabledelayedexpansion @REM read bluestack adb port set "filepath=[PATHTO]\BlueStacks_nxt\bluestacks.conf" set "search=bst.instance.Pie64.status.adb_port=" for...

Tested with torch and VeRL current implementation, the improvement is huge.  Currently integrated to `dp_actor.py`

The integration has OOM problem, with current fake-weight way. Will reconsider the fusion of linear layer with cross entropy.

Sorry for the close and open operations. Use main branch to PR may be a dangerous operation for maintainers to cooperation and rebase (QaQ) Next time will still use PR...

Megatron full integration is in progress, it takes some time to use transformer_engine's support for models.

After features supported, we will provide information in [https://verl.readthedocs.io/en/latest/workers/megatron_workers.html](https://verl.readthedocs.io/en/latest/workers/megatron_workers.html), and for more Megatron options included in `ppo_megatron_trainer.yml`, we will sync them to [https://verl.readthedocs.io/en/latest/examples/config.html](https://verl.readthedocs.io/en/latest/examples/config.html)

Hi @0x404 , thanks for your efforts~ Could you consider my suggestion and resolve conflicts?

@0x404 I add some modification to docs, loggings and saving logic, please review~

@0x404 please double check if there are any missing mistakes?

@HollowMan6 Thanks a lot for your contribution. This is actually an historical PR (cry) I have some suggestions, can you refactor and call me to run CI anytime you finish~