oslo
oslo copied to clipboard
OSLO: Open Source for Large-scale Optimization
## Describe a TODO feature - Added PatricStar chunk manager to Zero case ## Assignees -
## Describe a TODO feature - Test TP + PP on 4 GPus ## Assignees - @hyunwoongko @ohwi
## How to reproduce ```python python ./tests/transformers/models/mbart/test_training.py ``` ## Environment - OS : CentOS 7.9 - Python version : 3.9 - Transformers version : 4.21.2 - Whether to use Docker:...
## How to reproduce ```python python ./tests/transformers/models/electra/test_mlm.py ``` ## Environment - OS : CentOS 7.9 - Python version : 3.9 - Transformers version : 4.21.2 - Whether to use Docker:...
## Describe a TODO feature - Currently, PP only supports Modules with return type `tuple` - Need to support other types. ## Assignees - @ohwi
We'll make `oslo-examples` repository for users