Gong Zi issues

Repositories
Issues
Comments

Results 1 issues of


                                            Gong Zi

Gradient Accumulation Error with Ulysses Sequence Parallel Causes Inconsistent Loss

First of all, thank you for your great work on this repository! I encountered a loss inconsistency issue when using Ulysses Sequence Parallel for SFT (commit id: [2c85b432996ad28ed9756ae745e7fcb7ec6eee10](https://github.com/volcengine/verl/commit/2c85b432996ad28ed9756ae745e7fcb7ec6eee10)). In the...